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FIELD OF THE INVENTION 



[0003] This invention relates in general to the field of 
cache memories in microprocessors and particularly to cache 
memories that distinguish between stack and non- stack 
memory accesses. 
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BACKGROUND OF THE INVENTION 

[0001] A microprocessor is a digital device that 
executes instructions specified by a computer program. A 
typical computer system includes a microprocessor coupled 
to a system memory that stores program instructions and 
data to be processed by the program instructions. The 
performance of such a system is hindered by the fact that 
the time required to read data from the system memory into 
the microprocessor or to write data from the microprocessor 
to the system memory is typically much larger than the time 
required for the microprocessor to execute the instructions 
that process the data. The time difference is often 
between one and two orders of magnitude. Thus, the 
microprocessor may be sitting idle with nothing to do while 
waiting for the memory to be read or written. 
[0002] However, processor designers recognized long ago 
that programs tend to access a relatively small proportion 
of the data a relatively large proportion of the time, such 
as frequently accessed program variables. Programs with 
this characteristic are said to display goo'd temporal 
locality, and the propensity for this characteristic is 
referred to as the locality of reference principle. To 
take advantage of this principle, modern microprocessors 
typically include one or more cache memories. A cache 
memory, or cache, is a relatively small memory electrically 
close to the microprocessor core that temporarily stores a 
subset of data that normally resides in the larger, more 
distant memories of the computer system, such as the system 
memory. Caching data is storing data in a storage element 
of a cache memory so that the data can be subsequently more 
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quickly provided from the cache memory than from a more 
distant memory of the system. 

[0003] When the microprocessor executes a memory read 
instruction, such as a load or pop instruction, the 
microprocessor first checks to see if the requested data is 
present in the cache, i.e., if the memory read address hits 
in the cache. If not, i.e., if the memory read, address 
misses in the cache, the microprocessor fetches the data 
into the cache in addition to loading it into the specified 
register of the microprocessor. Now since the data is 
present in the cache, the next time a memory read 
instruction is encountered that requests the same data, the 
data can be fetched from the cache into the register for 
processing, rather than from system memory. The memory 
read instruction can be executed essentially immediately 
since the data is already present in the cache. 

[0004] A cache stores data in cache lines, or cache 
blocks. A cache line is the smallest unit of data than can 
be transferred between the cache and the system memory. An 
example of a cache line size is 64 bytes of data. When a 
memory read instruction causes a cache miss, an entire 
cache line implicated by the missing address is fetched 
into the cache, instead of only fetching the data requested 
by the memory read instruction. Consequently, subsequent 
memory read instructions that request data in the same 
cache line may be quickly executed because the data can be 
supplied from the cache rather than having to access system 
memory . 

[0005] In addition, when a memory write instruction is 
executed, such as a store or push instruction, if the 
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memory write address hits in the cache, the data may be 
immediately written into the cache line of the cache, 
thereby allowing the write of the data to system memory to 
be' deferred. Later, the cache will write the cache line to 
system memory, typically in order to make room for a newer 
cache line. This operation is commonly referred to as a 
writeback operation. Still further, some caches also 
allocate an entry in the cache when a memory write address 
misses in the cache. That is, the cache performs a 
writeback operation of an old cache line in an entry of the 
cache, and reads the new cache line implicated by the write 
address from system memory into the cache entry formerly 
occupied by the old cache line. This operation is commonly 
referred to as a write allocate operation. 

[0006] As may be observed, an efficiently performing 
cache may greatly improve the performance of. the 
microprocessor. The two main factors affecting cache 
efficiency are the cache hit rate and the cache access 
time. The hit rate of a cache is the ratio of cache hits 
to the sum of cache hits and misses. The access time is 
the number of processor core clock cycles required for the 
specified data to be read from or written to the cache. 

[0007] The largest factor affecting cache hit rate is 
the size of the cache, i.e., the number of data bytes that 
may be stored in the cache. The larger the cache, the 
larger the subset of system memory data stored in the 
cache, and hence the more likely the implicated cache line 
will be present in the cache. For this reason, there 
exists a motivation to increase the cache size. 
Historically, the size of the cache was typically limited 
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by the amount of physical space on the microprocessor die 
that could be devoted to the cache. However, as circuit 
component geometries steadily decrease, this limitation has 
also diminished. 

[0008] But, cache size also affects the access time of a 
conventional cache. Unfortunately, a larger cache 

typically has a longer access time than a smaller cache. 
This is because conventional cache memories are random 
access memories, i.e., the same amount of time ' is required 
to access any cache line in the cache. The greater the 
number of possible locations in which the data may be 
stored within the cache, the more complicated the circuitry 
required to locate the data specified by the memory 
address. Fortunately, the steady decrease in circuit 
component geometry sizes also reduces cache access time, 
and helps offset the negative effect of increased cache 
size . 

[0009] However, there is a constant demand for higher 
microprocessor clock frequencies, which necessarily implies 
a reduction ' in clock cycle times, which implies a larger 
number of clock cycles to access a cache. Consequently, 
there is a trend toward smaller caches in microprocessors, 
particularly level -1 (LI) caches. For example, the 
Pentium4® LI cache is only 8KB - a reduction from the 16KB 
LI data cache in the Pentium III®. It is not chip real 
estate demands that compel the cache size reduction. 
Rather, it is the shorter processor core clock cycle times 
that compel cache size reductions, in spite of the 
accompanying performance reductions that smaller caches 
induce . 



Docket CNTR.2233 6 

[0010] Therefore, what is needed is a way to increase 
the effective size of the cache or to reduce the cache 
access time or both. 

SUMMARY 

[0011] In one aspect, the present invention provides an 
apparatus and method for performing a fast pop operation 
from a random access cache memory. The apparatus 
distinguishes pushes to and pops from stack memory data 
distinctly from non-stack data. The apparatus includes a 
last-in-first-out (LIFO) memory, or stack memory, for 
storing row values. When push instruction data is stored 
into the cache, a row value of the row into which the push 
data was stored is selectively pushed onto the top of the 
LIFO. The row value is pushed if the push data implicates 
a newly allocated cache line in the cache memory; 
otherwise, the row value is not pushed onto the LIFO. The 
apparatus takes advantage of the fact that typically pop 
instructions are correlated with previous push instructions 
to perform a speculative fast pop operation. Presuming the 
push/pop correlation, in response to a pop instruction, the 
apparatus speculatively provides data from the cache line 
specified by the row value in the top LIFO entry 
immediately without waiting to calculate the pop source 
address and without waiting to determine whether the source 
address hits in the cache. The apparatus subsequently 
calculates the pop source address and compares an index 
portion thereof with the top LIFO entry row value to 
determine whether incorrect data was speculatively provided 
to the pop instruction. If so, action is taken to correct 
the condition and provide the correct data. If the pop 
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instruction will cause the next pop instruction to access a 
different cache line, i.e., if the pop instruction is 
popping the last data in the cache line indicated by the 
row value, then the apparatus pops the row value off the 
LIFO. 

[0012] In one embodiment, the cache is a set associative 
cache. In this embodiment, the apparatus includes a second 
LIFO for storing a way value. On a push, the way of the 
cache into which the push data was stored is also 
selectively pushed onto the second LIFO on the same basis 
as the row value. On a pop, the apparatus speculatively 
provides data from the cache line specified by the row 
value in the top first LIFO entry and the way value in the 
top second LIFO entry immediately without waiting to 
calculate the pop source address and without waiting to 
determine whether the source address, hits in the cache. In 
one embodiment, the first and second LIFO are a single LIFO 
storing a row/way pair. 

[0013] In one embodiment, the apparatus keeps track of 
the offset of the most recently pushed data within the 
cache line specified by the row and way values stored in 
the top LIFO entry. The offset is updated each time a pop 
or push instruction is encountered. If a pop instruction 
causes the offset to wrap to the next cache line, then the 
LIFO is popped. Conversely, if a push instruction causes 
the offset to wrap to the previous cache line, then the row 
and way of the push cache line are pushed onto the LIFO. 
Additionally, the offset is modified if an instruction is 
encountered that directly modifies the stack pointer, such 
as an instruction that adds a value to the stack pointer 
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register. If the modification causes the offset to wrap to 
the next cache line, then the LIFO is popped accordingly. 
[0014] The fast pop operation provides pop data 
potentially multiple clock cycles faster than a cache 
without the apparatus. In particular, the time required to 
calculate the pop source address and the time required to 
translate the physical source address are not included in 
the time to provide the speculative pop data. 
Additionally, the time required to perform a tag compare is 
not included in the time required to provide the 
speculative pop data. Consequently, in at least one 
embodiment, the pop data is provided three clock cycles 
earlier than a conventional cache would provide the data. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0015] FIGURE 1 is a block diagram of a pipelined 
microprocessor according to the present invention. 

[0016] FIGURE 2 is a block diagram illustrating the 
stack cache of Figure 1 according to the present invention. 

[0017] FIGURE 3 is a block diagram of additional 
elements of the. stack cache of Figure 1 according to the 
present invention . 

[0018] FIGURE 4 is a block diagram illustrating muxing 
logic of the LI data cache of Figure 1 according to the 
present invention . 

[0019] FIGURE 5 is a flowchart illustrating a fast pop 
operation from the stack cache of Figure 1 according to the 
present invention . 

[0020] FIGURE 6 is a flowchart illustrating a push 
operation to the stack cache of Figure 1 according to the 
present invention . 
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[0021] FIGURE 7 is a flowchart illustrating operation of 
the microprocessor of Figure 1 in response to an add to 
stack pointer instruction according to the present 
invention . 

[0022] FIGURE 8 is a flowchart illustrating a load 
operation from the stack cache of Figure 1 according to the 
present invention. 

[0023] FIGURE 9 is a flowchart illustrating a store 
operation to the LI data cache of Figure 1 according to the ^ 
present invention . 

[0024] FIGURE 10 is a timing diagram illustrating the 
timing of a fast pop operation of Figure 5 from the stack 
cache of Figure 1 according to the present invention. 

[0025] FIGURE 11 is a timing diagram illustrating the 
timing of a. speculative load from the stack cache operation 
of Figure 8 according to the present invention. 

[0026] FIGURE 12 is a timing diagram illustrating the 
timing of a normal, i.e., non- speculative , load from the 
stack cache operation of Figure 8 according to the present 
invention . 

[0027] FIGURE 13 is a timing diagram illustrating the 
timing of a load from the non-stack cache operation of 
Figure 8 according to the present invention. 

[0028] FIGURE 14 is a block diagram of a pipelined' 
microprocessor according to the present invention. 
[0029] FIGURE 15 is a block diagram illustrating the LI 
data cache of Figure 14 according to the present invention. 
[0030] FIGURE 16 is a flowchart illustrating a fast pop 
operation from the data cache of Figure 15 according to the. 
present invention . 
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[0031] FIGURE 17 is a flowchart illustrating a push 
operation to the data cache of Figure 15 according to the 
present invention . 

[0032] FIGURE 18 is a flowchart illustrating operation 
of the microprocessor of Figure 14 in response to an add to 
stack pointer instruction according to the present 
invention. 

[0033] FIGURE 19 is a timing diagram illustrating the 
timing of a fast pop operation of Figure 16 from the data 
cache of Figure 15 according to the present invention. 

DETAILED DESCRIPTION 

[0034] The present invention takes advantage of the fact 
that, broadly speaking, programs typically segregate system' 
memory into two regions: a stack region and a non-stack 
region. The non- stack region is commonly referred to as 
the heap. A major difference between the stack and the 
heap is that the heap is accessed in a random access 
manner; whereas, the stack is generally accessed in a last- 
in-first-out (LIFO) manner. Another distinction between 
the stack and the heap is the manner in which the 
instructions that read or write them specify the address of 
the location to be read or written. Instructions that read 
or write the heap generally specify the memory address 
explicitly. In contrast, instructions that read or write 
the stack generally specify the memory address implicitly 
via a special register in the microprocessor, commonly 
referred to as the stack pointer register. A push 
instruction updates the stack pointer register by the size 
of the data to be pushed onto the stack, and then stores 
the data from a register of the microprocessor to the 
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address in memory stored in the updated stack pointer 
register. In the x86 architecture, for example, a push 
instruction (such as a PUSH, CALL, or ENTER instruction) 
decrements the stack pointer register by the size of the 
data to be pushed (for example, 4 bytes if the data is a 
dword) , and then stores the data onto the stack at the 
address specified in the updated stack pointer register. 
Conversely, a pop instruction reads the data at the address 
stored in the stack pointer register, loads the data into a 
register in the microprocessor, and then updates the stack 
pointer register by the size of the data popped off the 
stack. In the x86 architecture, for example, a pop 
instruction (such as a POP, RET, or LEAVE instruction) 
increments the stack pointer register by the size of the 
data popped off the stack. Hence, by convention, according 
to its LIFO nature, the stack grows upward (i.e., in 
decreasing memory address) as data is pushed onto the 
stack, and correspondingly shrinks n downward (i.e., in 
increasing memory address) as data is popped off the stack. 
Consequently, the value stored in the stack pointer 
register is referred to as the top of the stack. 
[0035] A stack is a convenient mechanism for allocating 
memory space . One of the main uses of the stack in typical 
programs is to push subroutine parameters onto the stack 
along with the return address of the calling routine. The 
called subroutine returns to the calling routine by popping 
the return address off the stack into the microprocessor 
program counter, and the calling routine then pops the 
parameters off the stack to restore the stack to its pre- 
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call condition. An extremely useful feature of this notion 
is that it facilitates nested subroutine calls. 
[0036] The fast pop operations described herein take 
advantage of the fact that there is generally a one-to-one 
correspondence between push and pop instructions. That is, 
when a pop instruction is executed, the data popped off the 
stack is generally data that was previously pushed onto the 
stack by a corresponding push instruction. 

[0037] In the present disclosure, a pop instruction is 
an instruction that moves data from memory into the 
microprocessor, such as into a register of the register 
file of the microprocessor, and the memory location of the 
data is implicitly specified rather than explicitly in the 
instruction. In particular, the pop data memory location 
address is implicitly based on a value stored in a stack 
pointer register of the microprocessor. Examples of pop 
instructions in an x86 architecture processor are POP, RET, 
and LEAVE instructions, whose source operand is implicitly 
specified relative to the stack pointer register value and 
whose destination operand specifies a register of the 
processor register file. 

[0038] In the present disclosure, a load instruction is 
a non-pop instruction that moves data from memory into the 
microprocessor, such as into a register of the register 
file of the microprocessor. That is, the load instruction 
explicitly specifies the memory address of the source data, 
or at least explicitly specifies a register or set of 
registers that specify the memory address of the source 
data. An example of a load instruction in an x86 
architecture processor is a MOV instruction whose source 
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operand specifies a memory location and whose destination 
operand specifies a register of the processor register 
file. 

[0039] In the present disclosure, a push instruction is 
an instruction that moves data to memory from the 
microprocessor, such as from a register of the register 
file of the microprocessor, and the memory location of the 
data is implicitly specified rather than explicitly in the 
instruction. In particular, the push data memory location 
address is implicitly based on a value stored in the stack 
pointer register of the microprocessor. Examples of push 
instructions in an x86 architecture processor are PUSH, 
CALL, and ENTER instructions, whose destination operand is 
implicitly specified relative to the stack pointer register 
value and whose source operand specifies a register of the 
processor register file. 

[0040] In the present disclosure, a store instruction is 
a non-push instruction that moves data to memory from the 
microprocessor, such as from a register of the register 
file of the microprocessor to memory. That is, the store 
instruction explicitly specifies the memory address of the 
destination data, or at least explicitly specifies a 
register or set of registers that specify the memory 
address of the destination data. An example of a store 
instruction in an x86 architecture processor is a MOV 
instruction whose source operand specifies a register of 
the processor register file and whose destination operand 
specifies a memory location. 

[0041] Referring now to Figure 1, a block diagram of a 
pipelined microprocessor 100 according to the present 
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invention is shown. In one embodiment, microprocessor 100 
comprises a microprocessor whose instruction set conforms 
substantially to the x86 architecture instruction set. In 
particular, the instruction set includes an x86 POP, PUSH, 
CALL, RET, ENTER, and LEAVE instruction, among others. 
Additionally, the instruction set includes instructions 
that load data from memory and store data to memory, such 
as an x86 MOV instruction. However, the present invention 
is not limited to x86 architecture processors or to the x86 
instruction set. 

[0042] Microprocessor 100 includes a register file 112. 
Register file 112 comprises a plurality of registers for 
storing operands and state information of microprocessor 
100. In one embodiment, register file 112 includes general 
purpose registers, address segment registers, index 
registers, status and control registers, and an instruction 
pointer, or program counter, register. In one embodiment, 
register file 112 comprises at least a user-visible 
register set of x86 architecture microprocessors. In 
particular, register file 112 includes a stack pointer 
register 152 that stores the address of the top of the 
stack in system memory. In one embodiment, stack pointer 
register 152 is substantially similar to the x86 ESP 
register . 

[0043] Microprocessor 100 includes an instruction cache 
102, for caching cache lines of instruction bytes. In one 
embodiment, instruction cache 102 comprises a level-1 (LI) 
cache. Instruction cache 102 caches instructions fetched 
from a system memory coupled to microprocessor 100, such as 
push and pop instructions. The push and pop instructions 
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implicitly access a stack in system memory based on the top 
of stack address stored in stack pointer register - 152 . 

[0044] Microprocessor 100 also includes a bus interface 
unit 118, coupled to instruction cache 102. Bus interface 
unit 118 is coupled to a processor bus 132, which couples 
microprocessor 100 to the system memory. Bus interface 
unit 118 interfaces various functional units within 
microprocessor 100 to the processor bus 132. For example, 
bus interface unit 118 fetches instructions from the system 
memory into instruction cache 102. Additionally, bus 
interface unit 118 reads data from and writes data to the 
system memory, such as the stack in the system memory whose 
top is specified by stack pointer register 152. 

[0045] Microprocessor 100 also includes an instruction 
f etcher 104, coupled to instruction cache 102. .Instruction 
fetcher 104 fetches instructions from instruction cache 
102 . Instruction fetcher 104 sequentially fetches the next 
instruction specified by the instruction pointer register 
in register file 112 unless it encounters a program control 
change event, such as a branch instruction, in which case 
instruction fetcher 104 begins fetching instructions at the 
target address of the branch instruction, or an exception, 
in which case instruction fetcher 104 begins fetching 
instructions of the exception handler routine for the 
particular exception. 

[0046] Microprocessor 100 also includes a microcode 
memory 128, coupled to instruction fetcher 104. Microcode 
memory 12 8 stores, instructions to be fetched by instruction 
fetcher 104. In particular, microcode memory 128 includes 
exception handler, routine instructions for handling various 
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exception conditions generated by microprocessor 100. In 
one embodiment, microprocessor 100 generates an exception 
to correct the state of microprocessor 100 with respect to 
stack accesses in response to detection of an incorrect 
speculative provision of pop or load data, as described 
below. 

[0047] Microprocessor 100 also includes an instruction 
translator 106, coupled to instruction f etcher 104. 
Instruction translator 106 receives instructions from 
instruction f etcher 104, such as push and pop instructions, 
decodes the instructions, and translates the instructions 
into microinstructions for execution by the remainder of 
the microprocessor 100 pipeline. In one embodiment, the 
remainder of the microprocessor 100 pipeline comprises a 
RISC core that executes the microinstructions. In one 
embodiment, instruction translator 106 generates an 
indicator for each instruction to indicate whether the 
instruction from which the microinstruction is translated, 
referred to as a macroinstruction, is a push, pop, load, or 
store . 

[0048] Microprocessor 100 also includes an instruction 
scheduler 108, coupled to instruction translator 106. 
Instruction scheduler 108 receives translated 
microinstructions from instruction translator 106 and 
issues the microinstructions 134 to execution units 114, 
which execute the microinstructions. 

[0049] Execution units 114 receive microinstructions 134 
from instruction scheduler 108 and operands 142, such as 
push instruction data or the value of stack pointer 
register 152, from register file 112 and execute the 
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microinstructions 134. In one embodiment, execution units 
114 include an integer unit, a floating point unit, an MMX 
unit, an SSE unit, a branch unit, a load unit, and a store 
unit. The load unit executes instructions that load data 
from the system memory into microprocessor 100, including 
pop instructions. The store unit executes store 

instructions, i.e., instructions that store data into the 
system memory from microprocessor 100, including push 
instructions . 

[0050] Microprocessor 100 also includes a write-back 
stage 116, coupled to execution units 114. Write-back 
stage 116 receives the results of the instructions executed 
by execution units 114 and writes the results, such as pop 
instruction data, back to register file 112. 
[0051] Microprocessor 100 also includes a data cache 
126, coupled to bus interface unit 118 via bus 136 and to 
execution units 114 via bus 138. In one embodiment, data 
cache 126 is an LI data cache. Data cache 126 includes a 
stack cache 124 and a non- stack cache 122. . Bus interface 
unit 118 fetches data from the system memory into data 
cache 12 6 and writes data to the system memory from data 
cache 126. In particular, bus interface unit 118 writes 
back cache lines from stack cache 124 and non-stack cache 
122 to system memory, and reads cache lines from system 
memory for writing into an allocated entry of stack cache 
124 and non-stack cache 122. More particularly, bus 
interface unit 118 transfers data specified by push and pop 
instructions between the system memory stack and stack 
cache 124 . 
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[0052] In one embodiment, non-stack cache 122 comprises 
substantially a conventional LI data cache. That is, non- 
stack cache 122 comprises a conventional LI data cache 
designed to facilitate uniform access times for a random 
distribution of system memory addresses. In one 

embodiment, non- stack cache 122 comprises a 4-way set 
associative cache. However, the store unit distinguishes 
between push and non-push instruction data in determining 
whether to store the data to stack cache 124 or to non- 
stack cache 122. The store unit stores push instruction 
data to stack cache 124 rather than non-stack cache 122, 
and stores non-push instruction data, i.e., store 
instruction data, to non-stack cache 122. In this respect, 
non- stack cache 122 is different from a conventional cache. 
Stack cache 124 is described in detail with respect to 
Figure 2 . 

[0053] In one embodiment, microprocessor 100 also 
includes a level-2 (L2) cache that backs the LI instruction 
cache 102 and the LI data cache 126. In particular, the L2 
cache serves as a victim cache for cache lines evicted from 
the data cache 126 (both the non-stack cache 122 and stack 
cache 124), and the LI data cache 126 fills cache lines 
from the L2 cache. 

[0054] Referring now to Figure 2, a block diagram 
illustrating the stack cache 124 of Figure 1 according to 
the present invention is shown. Stack cache 124 includes a 
plurality of storage elements configured as a stack, or 
LIFO memory. The fact that the stack cache 124 is a stack 
or LIFO memory is not to be confused with the stack 
comprised in the system memory, whose top is specified by 
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the value in the stack pointer register 152. Rather, stack 
cache 124 caches data of the system memory stack. 
[0055] The embodiment of Figure 2 includes sixteen 
storage elements, or entries, designated as 0 through 15. 
The top entry is designated as entry 0 and thie bottom entry 
is designated as entry 15. However, the present invention 
is not limited to a particular number of entries in stack 
cache 124 . Each entry includes storage space for a cache 
line of data 206, an address tag 204 of the cache line 206, 
and a cache status 202 of the cache line 206. In one 
embodiment, the cache status 2 02 comprises status 
conforming substantially to the well-known MESI (Modified, 
Exclusive, Shared, Invalid) cache coherency state values. 
In one embodiment, a cache line 206 comprises 64 bytes of 
data. In one embodiment, tag 2 04 comprises a physical 
address of the cache line 206. 

[0056] In one embodiment, the tag 2 04 includes the upper 
significant bits of the cache line 206 physical address 
required to uniquely identify the cache line 206. In one 
embodiment, microprocessor 100 includes a memory paging 
system that translates virtual memory addresses into 
physical memory addresses, and the tag 2 04 also includes a 
virtual address of the cache line 206. In one embodiment, 
the virtual address comprises a hash of the virtual address 
bits, in order to reduce the amount of space required for 
storing the virtual address. Use of the virtual address 
portion of the tag 2 04 to perform speculative loads from 
stack cache 124 is described in detail below. 

[0057] Stack cache 124 receives new cache status for 
storing into MESI field 202 of the top entry via 
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sc_write_MESI signal 212. Stack cache 124 receives a new 
tag for storing into tag field 2 04 of the top entry via 
sc_write_tag signal 214. Stack cache 124 receives a new 
cache line for storing into data field 2 06 of the top entry 
via sc_write_data signal 216. Stack cache 124 also 
receives a push_sc signal 232 from control logic 302 of 
Figure 3. When control logic 302 asserts a true value on 
push_sc signal 232, stack cache 124 is shifted down one 
entry, i.e., the bottom entry is shifted out of stack cache 
124 and each of the other entries receives the value of the 
entry immediately above them, and the values on 
sc_write_MESI 212, sc__write_tag 214, and sc_write_data 216 
are written into the top entry of stack cache 124. In one 
embodiment, each dword of a cache line 206 of stack cache 
124 may be individually written via sc_write_data signal 
216. In one embodiment, a dword (or double-word) comprises 
four bytes. Other embodiments are contemplated in which 
each word (2 bytes) , or each byte of a cache line 2 06 of 
stack cache 124 may be individually written via 
sc_write_data signal 216. 

[0058] Stack cache 124 provides the MESI state 202 of 
each of its sixteen entries on an sc_MESI [15 : 0] signal 222. 
Stack cache 124 provides the tag 204 of each of its sixteen 
entries on an sc_tag[15:0] signal 224. Stack cache 124 
provides the cache line data 206 of each of its sixteen 
entries on an sc_data [15 : 0] signal 226. The cache line 206 
of the top entry is provided on sc__data[0], the cache line 
206 of the next to top entry is provided on sc_jiata[l], and 
so forth down to the cache line 206 of the bottom entry is 
provided on sc_data[15]. The tag 204 and MESI state 202 
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are similarly provided. Stack cache 124 also receives a 
pop_sc signal 234 from control logic 3 02 of Figure 3 . When 
control logic 3 02 asserts a true value on pop_sc signal 
234, stack cache 124 is shifted up one entry, i.e., the top 
entry is shifted out of stack cache 124, and each of the 
other entries receives the values of the entry immediately 
below them. In one embodiment, when an entry is popped 
from stack cache 124, i.e., when pop_sc signal 234 is true, 
the MESI state 2 02 of the bottom entry of stack cache 124 

is updated to a value of Invalid. The MESI state 202 of 

f 

all entries of stack cache 124 are initialized to a value 
of Invalid. 

[0059] Referring now to Figure 3, a block diagram of 
additional elements of stack cache 124 of Figure 1 
according to the present invention is shown. Stack cache 
124 includes control logic 302. 

[0060] Control logic 302 receives a push_instr signal 
342 from the store unit of execution units 114 of Figure 1. 
A true value on push_instr signal 34 2 indicates that the 
store unit is requesting to store data into data cache 126 
of Figure 1 in response to a push instruction received from 
instruction scheduler 108 of Figure 1. 

[0061] Control logic 3 02 also receives a pop_instr 
signal 344 from the load unit of execution units 114. A 
true value on pop_instr signal 344 indicates that the load 
unit is requesting to load data from data cache 126 in 
response to a pop instruction received from instruction 
scheduler 108. 

[0062] Control logic 302 also receives a load_instr 
signal 346 from the load unit of execution units 114. A 
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true value on load_instr signal 346 indicates that the load 
unit is requesting to load data from data cache 126 in 
response to a load instruction received from instruction 
scheduler 108. 

[0063] Control logic 302 also receives a store_instr 
signal 348 from the store unit of execution units 114. A 
true value on store_instr signal 34 8 indicates that the 
store unit is requesting to store data to data cache 126 in 
response to a store instruction received from instruction 
scheduler 108. 

[0064] Control logic 302 also receives an add__sp_instr 
signal 352 from the integer unit of execution units 114. A 
true value on add_sp_instr signal 3 52 indicates that the 
integer unit is notifying data cache 126 that an add to the 
stack pointer instruction was received from instruction 
scheduler 108, such as an x86 ADD instruction. In one 
embodiment, the add macroinstruction is adding an immediate 
value to the stack pointer register, such as an ADD ESP,imm 
instruction. 

[0065] Stack cache 124 also includes an address 
generator 3 06. Address generator 3 06 receives operands 
from register file 112 of Figure 1, such as base values, 
offsets, and memory descriptor values, and generates a 
virtual address 334 based on the values received. The 
virtual address 334 is a virtual memory address of an 
instruction that accesses memory, such as a push, pop, 
load, or store instruction. In the case of a load 
instruction, virtual address 334 is the virtual source 
address of the load data. In the case of a store 
instruction, virtual address 334 is the virtual destination 
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address of the store data. In the case of a pop 
instruction, virtual address 334 is the virtual source 
address of the pop data. In the case of a push 
instruction, virtual address 334 is the virtual destination 
address of the push data. In one embodiment, address 
generator 3 06 is comprised in each of the load and store 
units . 

[0066] Stack cache 124 also includes a translation look- 
aside buffer (TLB) 3 08, coupled to address generator 3 06. 
TLB 3 08 caches page table information used to translate 
virtual address 334 into a physical address 336. In one 
embodiment, only an upper portion of physical address 336 
is translated by TLB 3 08, and the lower portion of physical 
address 336 is simply the > corresponding lower portion of 
virtual address 334. In one embodiment, a minimum page 
size of 4KB; hence, the lower 12 address bits of physical 
address 336 are not translated. 

[0067] Stack cache 124 also includes two comparators 
312, coupled to address generator 306. The comparators 312 
each receive virtual address 3 34. One of the comparators 
312 receives the virtual address portion of sc_tag[0] 
signal 224 of Figure 2, and the other comparator 312 
receives the virtual address portion of sc_tag[l] signal 
224. That is, the two comparators 312 receive the 
respective virtual address portion of tag 2 04 of Figure 2 
of the top two entries of stack cache 124 and compare the 
respective virtual sc_tag 224 with virtual address 334. If 
virtual sc_tag[0] 224 matches virtual address 334, then the 
first comparator 312 generates a true value on a 
VA_match[0] signal 362, which is provided to control logic 
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302. Similarly, if virtual sc_tag[l] 224 matches virtual 
address 334, then the second comparator 312 generates a 
true value on a VA_match[l] signal 3 62, which is also 
provided to control logic 302. Control logic 302 also 
receives sc_MESI [15 : 0] signals 222 of Figure 2 from stack 
cache 124. Control logic 302 uses the VA__match [1 : 0] 
signals 362 and the scJVIESI [1 : 0] signals 222 to determine 
whether virtual address 334 hits in either of the top two 
entries of stack cache 124 in order to perform speculative 
loads from stack cache 124, as described in detail below. 
That is, control logic 3 02 uses the VA_match [1 : 0] signals 
362 and the scJVIESI [1 : 0] signals 222 to determine whether 
virtual address 334 matches a valid one of the virtual 
address portion of either of virtual sc_tag[l:0] 224. In 
the embodiment in which the virtual tag 204 is a hash of 
the virtual address bits, virtual address 334 is hashed 
before being provided to comparators 312. 

[0068] It is noted that although an embodiment of Figure 
3 is described in which the top two entries of stack cache 
124 are checked to determine whether a speculative load may 
be performed therefrom, other embodiments are contemplated 
in which more than the two top entries are checked, and 
another embodiment is contemplated in which only the top 
entry is checked. The greater the amount of data items 
implicated by the check, the greater the likelihood of 
detecting the ability to perform a fast load. 
Consequently, the greater the cache line size, the fewer 
the number of entries that need to be checked. The 
embodiment of Figure 3 provides checking for 12 8 bytes. 
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[0069] Stack cache 124 also includes sixteen comparators 
314, coupled to TLB 308. The comparators 314 each receive 
physical address 336. Comparators 314 also each receive a 
respective one of sc_tag[15:0] signal 224. That is, 
comparators 314 receive the respective physical address 
portion of tag 204 on respective sc_tag signal 224 and 
compare it with physical address 336. If physical 

sc_tag[0] 224 matches physical address 336, then the first 
comparator 314 generates a true value on a PA_match[0] 
signal 3 64, which is provided to control logic 3 02; if 
physical sc_tag[l] 224 matches physical address 336, then 
the second comparator 314 generates a true value on a 
PA__match[l] signal 364, which is also provided to control 
logic 3 02; and so forth for each of the sixteen comparators 
314. Control logic 3 02 uses the PAjnatch [15 : 0] signals 364 
and the scJVIESI [15 : 0] signals 222 to determine whether 
physical address 336 hits in any of the entries of stack 
cache 124 in order to perform loads from stack cache 124 
and to determine whether speculative pops or loads 
correctly or incorrectly speculatively provided their data, 
as described in detail below. That is, control logic 302 
uses the PA_match [15 : 0] signals 364 and the * sc_MESI [15 : 0] 
signals 222 to determine whether physical address 336 
matches a valid one of the physical address portion of 
sc_tag[15:0] 224. 

,[0070] Control logic 302 also generates a scjiit signal 

'V 

3 89, which is provided to the load and store units of 
execution units 114, to indicate that the cache line 
implicated by a pop, push, load, or store instruction is at 
least speculatively present in stack cache 124. In the 
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case of a pop instruction, control logic 302 speculatively 
generates a true value on sc_hit signal 3 89 in response to 
a true value on pop_instr signal 344 before verifying that 
the pop source address hits in the stack cache 124, as 
described below with respect to Figure 5. In the case of a 
push instruction, control logic 302 generates a true value 
on sc_hit signal 389 if sc_MESI [15 : 0] 222 and 
PA_match [15 : 0] 364 indicate that physical address 336 
matches a valid physical address tag in stack cache 124 or 
if stack cache 124 allocates the cache line implicated by 
physical address 336, as described below with respect to 
Figure 6. In the case of a load instruction, control logic 
3 02 speculatively generates a true value on sc_hit signal 
389 if scJVlESI [1:0] 222 and VA_match [1 : 0] 362 indicate that 
virtual address 3 34 matches a valid virtual address tag in 
one of the top entries of stack cache 124 or non- 
speculatively generates a true value on sc_hit signal 389 
if sc_MESI [15 :0] 222 and PA_match [15 : 0] 364 indicate that 
physical address 336 matches a valid physical address tag 
in stack cache 124, as described below with respect to 
Figure 8. In the case of a store instruction, control 
logic 302 generates a true value on sc_hit signal 389 if 
sc_MESI [15:0] 222 and PA_match [15 : 0] 364 indicate that 
physical address 3 36 matches a valid physical address tag 
in stack cache 124, as described below with respect to 
Figure 9 . 

[0071] Control logic 302 also receives a non-sc_hit 
signal 366 from non-stack cache 122 of Figure 1. The non- 
sc_hit signal 366 is true if physical address 336 hits in 
non-stack cache 122. Control logic 302 also generates 
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push__sc signal 232 and pop_sc signal 234 of Figure 2, whose 
operation is described herein. 

[0072] Stack cache 124 also includes an fp_offset 
register 322, coupled to control logic 3 02, for storing a 
value referred to as fp_offset. Register 322 outputs its 
value on an fp_offset signal 3 96, which is provided . to 
control logic 302. The fp_offset 322 value is used to 
perform a fast pop,, operation from stack cache 124, as 
described in detail below. As will be understood from 
study of the remaining Figures below, and in particular of 
the flowcharts of Figures 5 through 7, fp_offset 322 
specifies the location within the cache line stored in the 
top entry of stack cache 124 of the data specified by the 
most recent push instruction. That is, fp_offset 322 
specifies the location of • the data of a push instruction 
that has not yet been popped off the stack in main memory. 
In one embodiment, fp_offset 322 comprises a four-bit value 
for specifying an offset of one of sixteen dwords in the 
cache line 206 stored in the top entry of stack cache 124. 
Control logic 3 02 monitors pop, push, and add to stack 
pointer instructions to anticipate changes to the stack 
pointer register 152 and to keep the fp_offset 322 value 
consistent with bits [5:2] of stack pointer register 152.' 
In one embodiment, control logic 3 02 updates fp_offset 322 
when the load, store, or integer unit of execution units 
114 indicate that a pop, push, or add to stack pointer 
instruction, respectively, has been issued. In one 

embodiment, control logic 302 updates fp_offset 322 without 
waiting for the stack pointer register 152 to be updated by 
write-back stage 116. By doing this, a pop instruction 
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subsequent to a push, add to stack pointer, or other pop 
instruction may use the anticipated value of the stack 
pointer 152 without having to stall waiting for write-back 
stage 116 to update the stack pointer 152 and then obtain 
bits [5:2] from stack pointer register 152. 
[0073] Stack cache 124* also includes a sixteen-input 
multiplexer 318, coupled to fp_offset register 322. In one 
embodiment, multiplexer 318 includes sixteen inputs, each 
for receiving a respective one of the sixteen dwords of 
sc_data[0] signal 226. Multiplexer 318 receives fp_offset 
signal 396 as a select input to select one of the sixteen 
dwords of sc_data[0] to output on a fp_data 398 signal for 
provision^ to a pop instruction when performing a fast pop 
operation, as described below. 

[0074] Stack cache 124 also includes an arithmetic unit 
3 04, coupled to control logic 3 02. Arithmetic unit 3 04 
receives fp_offset signal 396. 

[0075] Arithmetic unit 304 also receives a decrement 
signal 384 from control logic 302. If control logic 302 
generates a true value on decrement signal 3 84, arithmetic 
unit 3 04 decrements the value received on fp_offset signal 
396 and provides the decremented value on an output 372. 
If the decrement operation results in an underflow, 
arithmetic unit 3 04 generates a true value on an underflow 
signal 388, which is provided to control logic 302. 

[0076] Arithmetic unit 304 also receives an increment 
signal 386 from control logic 302. If control logic 302 
generates a true value on increment signal 3 86, arithmetic 
unit 3 04 increments the value received on fp_offset signal 
3 96 and provides the incremented value on output 3 72. If 
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the increment operation results in an overflow, arithmetic 
unit .304 generates a true value on an overflow signal 392, 
which is provided to control logic 302. 

[0077] Arithmetic unit 304 also receives an add signal 
382 from control logic 302. If control logic 302 generates 
a true value on add signal 382, arithmetic unit 3 04 adds 
the value received on fp_offset signal 3 96 to the value 
received on an add_sp_val signal 3 94 and provides the sum 
on output 372. If the addition results in an overflow, 
arithmetic unit 3 04 generates a true value on overflow 
signal 392. In one embodiment, the add_sp_val signal 394 
is provided by the integer unit of the execution units 114 
of Figure 1. The value provided on add_sp_val signal 3 94 
is the value specified by an instruction that adds a value 
to the stack pointer 152. 

[0078] Stack cache 124 also includes a two-input 
multiplexer 316, coupled to fp_offset register 322. The 
output of multiplexer 316 is coupled to the input of 
fp_offset register 322. Multiplexer 316 receives output 
372 of arithmetic unit 304 on one input. Multiplexer 316 
receives bits [5:2] of the output of stack pointer register 
152 on its other input. Multiplexer 316 receives a control 
signal 368 from control logic 3 02 as a select input to 
select one of its inputs for outputting to fp_offset 
register 322. 

[0079] Stack cache 124 also includes a sixteen-input 
multiplexer 326, coupled to control logic 302. Each of the 
sixteen inputs of multiplexer 326 receives a respective one 
of the sixteen cache lines 206 of stack cache 124 provided 
on the sixteen respective sc_data [15 : 0] signals 226. 
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Multiplexer 326 selects one of the sixteen sc_data [15 : 0] 
signals 226 specified by a writeback_mux_sel signal 328 
generated by control logic 3 02. The output of multiplexer 
326 is provided as the input to a writeback line buffer 
324. The output of writeback line buffer 324 is provided 
on bus 136 to bus interface unit 118 of Figure 1. Control 
logic 3 02 also generates a writeback_request signal 33 8, 
which is also provided to bus interface unit 118. 
Writeback line buffer 324 and writeback_request signal 338 
are used to writeback a cache line from stack cache 124 to 
system memory, as described below. 

[0080] Control logic 3 02 also generates a true value on 
an allocate_f ill_buf f er signal 397 to allocate a fill 
buffer for fetching a cache line into system memory or from 
another cache memory in microprocessor 100, such as stack 
cache 124 or an L2 cache, as described below. 

[0081] Control logic 302 also generates a true value on 
an exception signal 3 99 to indicate that an exception 
condition has occurred to cause microprocessor 100 to 
branch to an exception handler in microcode memory 128, as 
described below. 

[0082] Control logic 302 also generates a 
spec_s c_load_mux_s el signal 3 91, a normalise JLoad_mux_sel 
signal 393, and an Ll_mux_sel signal 395, all of which are 
described below, particularly with respect to Figure 4. 

[0083] Referring now to Figure 4, a block diagram 
illustrating muxing logic of LI data cache 126 of Figure 1 
according to the present invention is shown. Data cache 
126 includes a four- input multiplexer 4 02, whose output is 
provided on bus 138 of Figure 1. In particular, 
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multiplexer 402 provides pop and load data on its output 
138 to the load unit in execution units 114 of Figure 1. 
[0084] The first input of multiplexer 402 receives 
output data 432 from non-stack cache 122 of Figure 1 to 
provide data for a load from non-stack cache 122. The 
second input of multiplexer 402 receives the output 424 of 
a sixteen- input multiplexer 4 04 to provide data for a 
speculative load from stack cache 124. The third input of 
multiplexer 402 receives the output 426 of a second 
sixteen- input multiplexer 4 06 to provide data for a normal, 
or non- speculative, load from stack cache 124. The fourth 
input of multiplexer 402 receives fp_data signal 398 of 
Figure 3 to provide data for a fast pop operation. 
[0085] Multiplexer 404 receives the sixteen dwords of a 
cache line 422 from the output of a two- input multiplexer 
412. Multiplexer 404 selects one of the sixteen dwords of 
cache line 422 based on a select input which is bits [5:2] 
of physical address 336 of Figure 3. 

[0086] t Multiplexer 406 receives the sixteen dwords of a 
cache line 428 from the output of a sixteen-input 
multiplexer 408. Multiplexer 406 selects one of the 
sixteen dwords of cache line 428 based on a select input 
which is bits [5:2] of physical address 336. 

[0087] The two inputs of multiplexer 412 receive the 
cache lines of the top two entries of stack cache 124 via 
sc_data[l:0] signal 226. Multiplexer 412 selects one of 
the two cache lines sc_data[l:0] 226 for output on signal 
422 based on spec_sc_load_mux_sel signal 3 91 of Figure 3, 
which control logic 3 02 generates based on the values of 
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load_instr signal 346, VA_match [1 : 0] signal 362, and 
sc_MESI[l:0] signal 222, as described below. 
[0088] Multiplexer 408 receives on respective ones of 
its sixteen inputs the cache lines of the sixteen entries 
of stack cache 124 via sc_data [15 : 0] signal 226. 
Multiplexer 408 selects one of the sixteen cache lines 
sc_data [15 : 0] 226 for output on signal 428 based on 
normal_sc_load_mux_sel signal 393 of Figure 3, which 
control logic 3 02 generates based on the values of 
load_instr signal 346, PA_match [15 : 0] signal 364, and 
sc_MESI [15 : 0] signal 222, as described below. 
[0089] Referring now to Figure 5, a flowchart 
illustrating a fast pop operation from stack cache 124 of 
Figure 1 according to the present invention is shown. Flow 
begins at block 502. 

[0090] At block 502, instruction translator 106 of 
Figure 1 decodes a pop instruction and instruction 
scheduler 108 of Figure 1 issues the pop instruction to the 
load unit of execution units 114 of Figure 1. In response, 
the load unit generates a true value on pop_instr signal 
344 of Figure 3. Flow proceeds to block 504. 

[0091] At block 504, multiplexer 318 selects the 
appropriate dword from the cache line sc_data[0] 226 in the 
top entry of stack cache 124 for provision on fp_data 
signal 3 98 based on the value currently stored in fp_offset 
register 322 of Figure 3. In response to the true value on 
pop_instr signal 344, control logic 302 of Figure 3 
generates a value on Ll_mux_sel signal 3 95 of Figure 3 to 
cause multiplexer 402 of Figure^ 4 to select the fp_data 
input 398 of Figure 3 for provision on bus 138 to the load 
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unit of execution units 114 for provision to the pop 
instruction, which write-back stage 116 subsequently loads 
into one of the registers of register file 112 of Figure 1 
specified in the pop instruction. For example, if the pop 
instruction is an x86 RET instruction, then the pop data is 
loaded into the instruction pointer register of register 
file 112. For example, if the pop instruction is an x86 
LEAVE instruction, then the pop data is loaded into the x86 
.EBP of register file 112. For example, if the pop 
instruction is an x86 POP instruction, then the pop data is 
loaded into the register of register file 112 specified in 
the POP instruction. As may be observed from Figure 5, the 
data is provided to the load unit speculatively. The 
operation is speculative because it has not yet been 
verified that the source address of the pop instruction, 
which will be subsequently generated on physical address 
336 at block 516, is the same as the address of the pop 
data provided from the top entry of stack cache 124 to the 
load unit . Also in response to the true value on pop_instr 
signal 344, control logic 3 02 generates a true value on 
sc_hit signal 389 of Figure 3, which is provided to the 
load unit of execution units 114. Flow proceeds to block 
506. 

[0092] At block 506., control logic 302 generates a true 
value on increment signal 3 86, and arithmetic unit 3 04 
responsively increments fp_offset 3 96 and provides the 
incremented value on output 372, which control logic 302 
causes multiplexer 316 to select via control signal 368 for 
loading into fp_of f set register 322 of Figure 3 . Flow 
proceeds to decision block 508. 
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[0093] At decision block 508, control logic 3 02 examines 
overflow signal 3 92 to determine whether the increment 
operation performed at block 506 caused an overflow of 
fp_offset 322. That is, control logic 302 determines 
whether the pop instruction will cause the stack pointer 
152 to wrap to the next cache line. If so, flow proceeds 
to block 512; otherwise, flow proceeds to block 514. 

[0094] At block 512, control logic 302 generates a true 
value on pop_sc signal 234 to pop the top entry off stack 
cache 124 . The top entry is popped off stack cache 124 to 
keep the stack cache 124 consistent with the system memory 
cache, since the last dword in the cache line stored in the 
top entry is now being popped off the system memory stack 
by the pop instruction. In one embodiment, block 512 is 
not performed until block 518, described below, has been 
performed so that the physical address 3 36 may be compared 
with the sc_tag[0] 224 value of the entry from which the 
data was provided during block 504. In one embodiment, the 
sc_tag[0] 224 value used at block 504 is saved for 
subsequent use at block 518. Although an embodiment is 
described in which fp_offset 322 is maintained as a dword 
offset to accommodate dword push and pop instructions, 
other embodiments are contemplated that accommodate other 
push and pop data sizes, such as words, bytes, or quad- 
words. Flow proceeds to block 514. 

[0095] At block 514, address generator 306 calculates 
the source virtual address 334 of Figure 3 of the pop 
instruction. Flow proceeds to block 516. 
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[0096] At block 516, TLB 308 generates the source 
physical address 336 of * Figure 3 of the pop instruction. 
Flow proceeds to block 518. 

[0097] At block 518, one of the comparators 314 of 
Figure 3 compares the physical address 3 36 generated at 
block 516 with the physical sc_tag[0] 224 of Figure 2 to 
generate PA__match[0] signal 364 of Figure 3. Flow proceeds 
to decision block 522. 

[0098] At decision block 522, control logic 302 examines 
sc_MESI [0] signal 222 of Figure 2 and PA_match[0] signal 
364 to determine whether the top entry of stack cache 124 
is valid and whether the source physical address 336 of the 
pop instruction matches the physical tag 204 of the top 
stack cache 124 entry, i.e., whether physical address 336 
hits in the top entry of stack cache 124. In one 
embodiment, bits [5:2] of physical address 336 are also 
compared with the value of fp_offset 3 96 that was used to 
select the dword provided on fp_data 3 98 to verify that the 
correct dword was provided. If the pop instruction source 
address 336 hits in the top entry of stack cache 124, flow 
ends, i.e., the speculative fast pop operation provided the 
correct pop data. Otherwise, flow proceeds to block 524. 

[0099] At block 524, control logic 302 generates a true 
value on exception signal 399 to cause microprocessor 100 
to branch to an exception handler for handling the 
condition in which the speculative fast pop operation 
provided the incorrect pop data. In one embodiment, the 
exception handler flushes stack cache 124 and loads the 
current value of bits [5:2] of the stack pointer register 
152 into fp_offset register 322. The exception handler 
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causes the correct data to be provided to the pop 
instruction. In one embodiment, flushing stack cache 124 
includes writing back to system memory or an L2 cache any 
valid cache lines in stack cache 124 to system memory. 
Flow ends at block 524 . 

[00100] As may be observed, and as will be discussed in 
more detail below with respect to Figure 10, the fast pop 
operation described with respect to Figure 5 enables pop 
data to be provided to a pop instruction potentially 
multiple clock cycles faster than with a conventional cache 
memory that makes no distinction between pop instructions 
and load instructions. 

[00101] Referring now to Figure 6, a flowchart 
illustrating a push operation to the stack cache 124 of 
Figure 1 according to the present invention is shown. Flow 
begins at block 602. 

[00102] At block 602, instruction translator 106 of 
Figure 1 decodes a push instruction and instruction 
scheduler 108 of Figure 1 issues the push instruction to 
the store unit of execution units 114 of Figure 1. In 
response, store unit generates a true value on push_instr 
signal 342 of Figure 3. Flow proceeds to block 604. 

[00103] At block 604, control logic 302 generates a true 
value on decrement signal 3 84, and arithmetic unit 304 
responsively decrements fp_offset 3 96 and provides the 
decremented value on output 3 72, which control logic 3 02 
causes multiplexer 316 to select via control signal 368 for 
loading into fp__offset register 322 of Figure 3. 
Additionally, in response to a true value on push_instr 
signal 342, control logic 3 02 generates a true value on 
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sc_hit signal 389, which is provided to the store unit of 
execution units 114. Flow proceeds to block 606. 
[00104] At block 606, address generator 306 calculates 
the destination virtual address 334 of Figure 3 of the push 
instruction. Flow proceeds to block 608. 

[00105] At block 608, TLB 308 generates the destination 
physical address 336 of Figure 3 of the push instruction. 
Flow proceeds to block 612. 

[00106] At block 612, one of the comparators 314 of 
Figure 3 compares the physical address 336 generated at 
block 516 with the physical sc_tag[0] 224 of Figure 2 to 
generate PA_match[0] signal 364 of Figure 3. Flow proceeds 
to decision block 614. 

[00107] At decision block 614, control logic 3 02 examines 
sc__MESI [0] signal 222 of Figure 2 and PA_match[0] signal 
364 to determine whether the top entry of stack cache 124 
is valid and whether the destination physical address 336 
of the push instruction matches the physical tag 204 of the 
top stack cache 124 entry, i.e., whether physical address 
336 hits in the top entry of stack cache 124. If so, flow 
proceeds to block 616. Otherwise, flow proceeds to 
decision block 618. In one embodiment, if physical address 
336 hits in an entry of stack cache 124 other then the top 
entry, then the stack cache 124 is flushed after valid 
entries are written back to system memory and then flow 
proceeds to block 616. 

[00108] At block 616, the push data is stored into the 
top entry of stack cache 124 via sc_write_data signal 216 
into the dword offset of the cache line 206 indicated by 
address bits [5:2] of physical address 336. If necessary, 
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the MESI state 202 of the top entry is updated via 
sc_write_MESI signal 212, such as to a value of Modified. 
The push data is obtained from the register of register 
file 112 specified by phe push instruction. For example, 
if the push instruction is an x86 CALL instruction, then 
the push data is the next sequential instruction pointer 
calculated from the instruction pointer register of 
register file 112. For example, if the push instruction is 
an x86 ENTER instruction, then the push data is the value 
in the x86 EBP register of register file 112. For example, 
if the push instruction is an x86 PUSH instruction, then 
the push data is the register of register file 112 
specified in the PUSH instruction. Flow ends at block 616. 
[00109] At decision block 618, since the push data 
destination address 336 missed in stack cache 124, a new 
entry, namely the top entry, in stack cache 124 must be 
allocated for the cache line implicated by the push 
destination address 336. Since stack cache 124 will be 
shifted down to allocate the top entry for the new cache 
line, the bottom entry will necessarily be shifted out of 
stack cache 124. Therefore, control logic 3 02 examines 
sc_MESI [15] 222 to determine whether the bottom stack cache 
124 entry is valid. If so, flow proceeds to block 622; 
otherwise, flow proceeds to block 624. 

[00110] At block 622, control logic 302 schedules a 
writeback of the bottom stack cache 124 entry by generating 
a value on writeback_mux_select signal 328 to cause 
multiplexer 326 to select sc_data[15] 226, i.e., the bottom 
stack cache 124 entry cache line, for provision to 
writeback line buffer 324, and then generates a true value 
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on writeback_request signal 338 to request bus interface 
unit 118 of Figure 1 to write the cache line back to system 
memory of the L2 cache. Flow proceeds to block 624. 
[00111] At block 624, control logic 302 asserts push_sc 
signal 232 to shift stack cache 124 down one entry and to 
store the push data, its tag, and MESI state onto stack 
cache 124 via sc_write_data signal 216, sc_write_tag signal 
214,. and sc_write_MESI signal 212, respectively. Flow 
proceeds to block 626. 

[00112] At block 626, control logic 302 allocates a fill 
buffer to establish ownership for stack cache 124 of the 
cache line implicated by the destination address 336 of the 
push instruction and to fetch the implicated cache line 
into. In one embodiment, block 626 includes snooping non- 
stack cache 122 and the L2 cache and obtaining the 
implicated cache line from the non-stack cache 122 or L2 
cache if it is present . in either of the other two caches. 
Flow proceeds to block 628. 

[00113] At block 628, the implicated cache line is 
received into the fill buffer allocated at block 626, and 
the cache line data is merged with the push data stored 
therein at block 624 into the top entry of stack cache 124 . 
Flow ends at block 628. 

[00114] Referring now to Figure 7, a flowchart 
illustrating operation of microprocessor 100 of Figure 1 in 
response to an .add to stack pointer instruction according 
to the present invention is shown. As described above, the 
fast pop operation takes advantage of the fact that in most 
well-behaved programs, there is a one-to-one correspondence 
between push instructions and pop instructions. That is, 
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each push instruction is eventually followed by a 
corresponding pop instruction. However, there is at least 
one notable exception to this rule which regards the 
passing of subroutine parameters, which will now be 
described with respect to x86 instructions. 

[00115]. In the C language, for example, function 
parameters are passed on the system memory stack. A series 
of PUSH instructions, one for each parameter, is executed 
to push the parameters onto the stack. For example, before 
calling a function that receives five 4 -byte parameters, 
the calling function executes five PUSH instructions to 
push the five parameters onto the stack. Then the calling 
function executes a CALL instruction, which pushes the 
return address onto the stack and transfers control to the 
subroutine. The last instruction the subroutine executes 
is a RET instruction, which pops the return address off the 
stack. The calling routine must now reclaim the space on 
the stack that was occupied by the parameters. One option 
is to execute a series of five POP instructions to restore 
the stack pointer to its value before the parameters were 
pushed onto the stack. However, since the parameters are 
not needed by the calling function, most compilers simply 
execute an ADD instruction to add the size of the space 
occupied by the parameters back to the stack pointer. That 
is, rather than executing five POP instructions, the 
compiler generates a single ADD instruction, which is 
faster and smaller. In the example above, the calling 
routine would add 2 0 to the stack pointer. This is the 
most common sequence in which PUSH and POP instructions do 
not match up. Consequently, in one embodiment, the fast 
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pop apparatus advantageously decodes an instruction that 
adds a value to the stack pointer and updates the fp_offset 
322 value accordingly. Flow begins in Figure 7 at block 
702. 

[00116] At block 702, instruction translator 106 of 
Figure 1 decodes an add instruction whose destination is 
stack pointer register 152 of Figure 1, and instruction 
scheduler 108 of Figure 1 issues the add instruction to the 
integer unit of execution units 114 of Figure 1. In 
response, the integer unit generates a true value on 
add_sp_instr signal 352 of Figure 3. Flow proceeds to 
block 704. 

[00117] At block 704, control logic 302 generates a true 
value on add signal 3 82, and arithmetic unit 3 04 
responsively adds add_sp_val 3 94 to fp_off set- 3 96 and 
provides the sum on output 372, which control logic 302 
causes multiplexer 316 to select via control signal 368 for 
loading into fp_offset register 322 of Figure 3. Flow 
proceeds to decision block 706. 

[00118] At decision block 706, control logic 3 02 examines 
overflow signal 3 92 to determine whether the add operation 
performed at block 704 caused an overflow of fp_offset 322. 
That is, control logic 3 02 determines whether the add 
instruction will cause the stack pointer 152 to wrap to 
another cache line. At block 706, an overflow condition is 
a condition in which the add causes stack pointer 152 to no 
longer reference the cache line stored in the top entry of 
stack cache 124. • In particular, if the add causes an 
overflow, stack pointer 152 typically references the cache 
line whose memory address is immediately adjacent to and 
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greater than the memory address of the cache line stored in 
the top entry of stack cache 124. Consequently, stack 
cache 124 must be popped in order for the correct cache 
line to be present in the top entry. In one embodiment, 
control logic 302 accommodates an add to stack pointer 152 
that overflows more than one cache line. In this 
embodiment, the number of entries, N, popped from stack 
cache 124 at block 708 below is calculated as follows, 
assuming a cache line size of 64 bytes: 

N = (fp_offset + add_sp__val) / 64 

Hence, if N is greater than 1, then an overflow has 
occurred. If an overflow condition occurred, flow proceeds 
to block 708; otherwise flow ends. 

[00119] At block 708, control logic 302 generates a true 
value on pop_sc signal 234 to pop the top entry off stack 
cache 124. First however, control logic 302 determines 
whether the cache line stored in the top entry is valid, 
and if so, schedules a writeback of the valid cache line to 
system memory or the L2 cache, similar to the manner in 
which the bottom entry of written back at block 622 of 
Figure 6. As discussed above with respect to block 706, in 
one embodiment, the value of N is calculated, and N entries 
are popped from stack cache 124 and all valid cache lines 
in the N entries are written back. Flow ends at block 708. 
[00120] Referring now to Figure 8 , a flowchart 
illustrating a load operation from the stack cache 124 of 
Figure 1 according to the present invention is shown. 
Figure 8 comprises Figures 8A, 8B, and 8C, referred to 
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collectively as Figure 8. Generally, Figure 8A illustrates 
a speculative load operation from stack cache 124 of Figure 
1; Figure 8B illustrates a normal load operation from stack 
cache. 124; and Figure 8C illustrates a load from non-stack 
cache 122 of Figure 1. Flow begins at block 802. 
[00121] Another main use of the system memory stack in 
typical programs is to allocate space for subroutine local 
variables on the stack. The subroutine allocates space on 
the stack by decrementing the stack pointer by the amount 
of space allocated for the local variables. The local 
variables are then accessed by load instructions by an 
address calculated as an offset relative to the stack 
pointer. Consequently, there is a high probability that 
the load data will be in the same cache line as the most 
recently pushed data. Additionally, it is highly likely 
that the subroutine will execute load instructions to 
access the parameters pushed on the stack for it by the 
calling routine. There is a significant probability that 
the pushed parameters will span two cache lines, i.e., that 
one of the push instructions caused a wrap to the next 
cache line, as described with respect to blocks 618 through 
628 of Figure 6. Consequently, some of the parameters will 
be in the cache line in the next to top entry of stack 
cache 124 rather than the top entry or even in the next to 
next to top entry and so forth. Therefore, in one 
embodiment, the speculative load from stack cache 124 
operation takes advantage of this fact by checking the 
stack cache 124 to see if the load data is present in the 
top two entries. By checking the top two entries directly, 
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the row decode operation of a conventional cache memory is 
avoided, thereby potentially saving a clock cycle. 
[00122] Additionally, in one embodiment, the speculative 
load potentially saves an additional clock cycle by using 
the load instruction virtual address 334 rather than the 
physical address 3 36 to perform the tag compare to see if 
the load data is present in the top two entries. If the 
virtual address matches one of the top two entries, then it 
is highly probable that the load data is present in the 
hitting entry, although not certain due to the possibility 
of virtual aliasing. In one embodiment of microprocessor 
100, the cause of the stack cache 124 speculatively 
providing incorrect data on a speculative load operation is 
an operating system task switch, which may update memory 
paging information, thereby causing a false virtual address 
match. In one embodiment, particularly in a microprocessor 
100 that employs a stack address segment register, such as 
the SS register in the x86 architecture, for example, the 
cause of the stack cache 124 speculatively providing 
incorrect data on a speculative load operation is an update 
of the stack segment register, which affects the effective 
address calculation, thereby potentially causing a false 
virtual address match. 

[00123] Although Figure 8 describes an embodiment in 
which the top two entries of stack cache 124 are checked as 
candidates for performing a speculative load operation, the 
speculative load operation is not limited to a particular 
number of top stack cache 124 entries to be checked, and 
various embodiments . are contemplated in which various 
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numbers of entries of stack cache 124 are checked by the 
speculative load from stack cache 124 operation. 
[00124] At block 802, instruction translator 106 of 
Figure, 1- decodes a load instruction and instruction 
scheduler 108 of Figure 1 issues the load instruction to 
the load unit of execution units 114 of Figure 1. In 
response, load unit generates a true value on load_instr 
signal 346 of Figure 3. Flow proceeds to block 804. 
[00125] At block 804, address generator 306 calculates 
the source virtual address 334 of Figure 3 of the load 
instruction. Flow proceeds to block 806. 

[00126] At block 806, the two comparators 312 of Figure 3 
compare the virtual address 336 generated at block 804 with 
virtual sc_tag[l:0] 224 of Figure 2 to generate 
VA_match [1 : 0] signal 362 of. Figure 3. Flow proceeds to 
decision block 808. 

[00127] At decision block 808, control logic 302 of 
Figure 3 examines scJVIESI [1 : 0] signal 222 of Figure 2 and 
VA_match [1 : 0] signal 362 to determine whether either of the 
top two entries of stack cache 124 is valid and whether the 
source virtual address 334 of the load instruction matches 
the virtual portion of the tag 2 04 of the top two stack 
cache 124 entries, i.e., whether virtual address 334 hits 
in the top two entries of stack cache 124. If so, flow 
proceeds to block 812. Otherwise, flow proceeds to block 
824 of Figure 8B. 

[0012.8] At block 812, in response to the true value on 
load_instr signal 346, control logic 302 generates a value 
on spec_sc_load_mux_sel signal 391 to cause multiplexer 412 
to select for provision on signal 422 of Figure 4 the one 
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of the two cache lines sc_data[l:0] 226 of stack cache 124 
that is determined at decision block 8 08 to have a valid 
virtual tag 204 that matches the source virtual address 334 
of the load instruction. Additionally, multiplexer 404 
selects a dword from cache line 422 specified by physical 
address [5: 2] 336 for provision on signal 424 of Figure 4. 
Further, control logic 3 02 generates a value on Ll_mux_sel 
signal 395- of Figure 3 to cause multiplexer 4 02 of Figure 4 
to select input 424 for provision on bus 13 8 to the load 
unit of execution units 114 for provision to the load 
instruction, which write-back stage 116 subsequently loads 
into one of the registers of register file 112 of Figure 1 
specified in the load instruction. As may be observed from 
Figure 8A, the data is provided to the load unit 
speculatively. The operation is speculative because it has 
not yet been verified that the source physical address of 
the load instruction, which will be subsequently generated 
on physical address .336 at block 814, is the same as the 
address of the load data provided from one of the two top 
entries of stack cache 124 to the load unit. In response 
to detection at block 808 that 4 virtual address 334 hits in 
the top two entries of stack cache 124, control logic 302 
generates a true value on sc_hit signal 389, which is 
provided to the load unit of execution units 114. Flow 
proceeds to block 814. 

[00129] At block 814, TLB 308 generates the source 
physical address 336 of the load instruction. Flow 
proceeds to block 816. 

[00130] At block 816, two of the comparators 314 of 
Figure 3 compare the physical address 33 6 generated at 
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block 814 with the physical sc_tag[l:0] 224 from which the 
load data was speculatively provided at block 812 to 
generate the respective PAjnatch [1 : 0] signal 364 of Figure 
3. Flow proceeds to decision block 818. 

[00131] At decision block 818, control logic 302 examines 
the PA_match [1 : 0] signal 364 corresponding to the entry of 
stack cache 124 from which the load data was speculatively 
provided at block 812 to determine whether the source 
physical address 336 of the load instruction matches the 
physical tag 204 of the entry, i.e., whether physical 
address 336 hits in the entry. If the load instruction 
source address 336 hits in the speculated entry of stack 
cache 124, flow ends, i.e., the speculative load operation 
provided the correct pop data. Otherwise, flow proceeds to 
block 822 . 

[00132] At block 822, control logic 302 generates a true 
value on exception signal 399 to cause microprocessor 100 
to branch to an exception handler for handling the 
condition in which the speculative load operation provided 
the incorrect load data. The exception handler causes the 
correct data to be provided to the load instruction. In 
one embodiment, the exception handler loads the correct 
data from non- stack cache 122 or from system memory or the 
L2 cache. Flow ends at block 822. 

[00133] As may be observed, and as will be discussed in 
more detail below with respect to Figure 11, the 
speculative load operation from the stack cache 124 
described with respect to Figure 8A enables load data to be 
provided to a load instruction potentially multiple clock 
cycles faster than with a conventional cache memory. 
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[00134] At block 824 of Figure 8B, TLB 308 generates the 
source physical address 3 36 of the load instruction. Flow 
proceeds to block 826. 

[00135] At block 826, the comparators 314 of Figure 3 
compare the physical address 3 36 generated at block 824 
with the physical sc_tag[15:0] 224 of each of the sixteen 
stack cache 124 entries to generate PAjnatch [15 : 0] signal 
364. Flow proceeds to decision block 828. 

[00136] At decision block 828, control logic 302 examines 
scJVIESI [15 : 0] signal 222 and PA__match [15 : 0] signal 364 to 
determine whether any of the stack cache 124 entries is 
valid and whether the source physical address 336 of the 
load instruction matches the physical tag 204 of a valid 
stack cache 124 entry, i.e., whether physical address 336 
hits in stack cache 124. If the load instruction source 
address 336 hits in stack cache 124, flow proceeds to block 
832; otherwise, flow proceeds to block 834 of Figure 8C. 
[00137] At block 832, in response to the true value on 
load_instr signal 34 6, and in response to the source 
virtual address 334 of the load instruction missing in the 
top two entries of stack cache 124, and in response to the 
load instruction source address 336 hitting in stack cache 
124, control logic' 3 02 generates a value on 
normal_sc_load__mux_sel signal 3 93 to cause multiplexer 4 08 
to select for provision on signal 428 of Figure 4 the one 
of the sixteen cache lines sc__data [15 : 0] 226 of stack cache 
124 that is determined at decision block 828 to have a 
valid physical tag 204 that matches the source physical 
address 336 of the load instruction. Additionally, 
multiplexer 4 06 selects a dword from cache line 428 
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specified by physical address [5:2] 336 for provision on 
signal 426 of Figure 4. Further, control logic 302 
generates a value on Ll_mux_sel signal 3 95 to cause 
multiplexer 402 to select input 426 for provision on bus 
138 to the load unit of execution units 114 for provision 
to the load instruction, which write-back stage , 116 
subsequently loads into one of the registers of register 
file 112 of Figure 1 specified in the load instruction. In 
response to detection at block 828 that physical address 
336 hits in stack cache 124, control logic 302 generates a 
true value on sc_hit signal 3 89, which is provided to the 
load unit of execution units 114. Flow ends at block 832. 
[00138] As may be observed, and as will be discussed in 
more detail below with respect to Figure 12, the normal 
load operation from the stack cache 124 described with 
respect to Figure 8B enables load data to be provided to a 
load instruction potentially at least one clock cycle 
faster than with a conventional cache memory, such as non- 
stack cache 122. 

[00139] At block 834 of Figure 8C, non-stack cache 122 
receives an index portion of physical address 336 generated 
at block 824 of Figure 8B and responsively performs a row 
decode of the index to select a row, or set of ways, in 
non- stack cache 122. Flow proceeds to block 83 6. 

[00140] At block 836, non-stack cache 122 compares an 
upper, or tag, portion of physical address 336 generated at 
block 824 with the physical address tag of each way in the 
set selected at block 834. Flow proceeds to decision block 
838 . 
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[00141] At decision block 838, non-stack cache 122 
examines the comparison results of block 836 and valid bits 
of the selected ways to determine whether the load physical 
address 336 hits in non-stack cache 122. If so, flow 
proceeds to block 842; otherwise, flow proceeds to block 
844 . 

[00142] At block 842, non-stack cache 122 provides the 
load data from the entry of non- stack cache 122 in which 
the physical address 336 hit. Flow ends at block 842. 

[00143] At block 844, in response to the determination at 
decision block 838 that the load physical address 336 
misses in non-stack cache 122, non-stack cache 122 
allocates an entry therein for loading the missing cache 
line implicated by the load instruction physical address 
336. Flow proceeds to block 846. 

[00144] At block 846, non-stack cache 122 fetches the 
missing cache line from system memory or the L2 cache into 
the entry of non-stack cache 122 allocated at block 844. 
Flow proceeds to block 848. 

[00145] At block 848, non-stack cache 122 provides the 
load data from the cache line fetched at block 846. Flow 
ends at block 848. 

[00146] In one embodiment, blocks 834 through 848 of 
Figure 8C are performed according to conventional cache 
techniques. That is, Figure 8C depicts a conventional load 
from conventional non- stack cache 122, which is performed 
in the event that the load address 3 36 misses in stack 
cache 124 . 

[00147] Referring now to Figure 9, a flowchart 
illustrating a store operation to the LI cache 126 of 
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Figure 1 according to the present invention is shown. Flow 
begins at block 902. 

[00148] At block 902, instruction translator 106 of 
Figure 1 decodes a store instruction and instruction 
scheduler 108 of Figure 1 issues the store instruction to 
the store unit of execution units 114 of Figure 1. In 
response, store unit generates a true value on store_instr 
signal 348 of Figure 3. Flow proceeds to block 904. 
[00149] At block 904, address generator 306 calculates 
the destination virtual address 334 of Figure 3 of the 
store instruction. Flow proceeds to block 906. 
[00150] At block 906, TLB 308 generates the destination 
physical address 336 of Figure 3 of the store instruction. 
Flow proceeds to block 908. 

[00151] At block 908, the comparators 314 of Figure 3 
compare the physical address 336 generated at block 906 
with the physical sc_tag[15:0] 224 of each of the sixteen 
stack cache 124 entries to generate PA_match [15 : 0] signal 
364. Flow proceeds to decision block 912. 

[00152] At decision block 912, control logic 302 examines 
sc__MESI [15 : 0] signal 222 and PA_match [15 : 0] signal 364 to 
determine whether any of the stack cache 124 entries is 
valid and whether the destination physical address 33 6 of 
the store instruction matches the physical tag 204 of a 
valid stack cache 124 entry, i.e., whether physical address 
336 hits in stack cache 124. If the store instruction 
destination address 336 hits in stack cache 124, flow 
proceeds to block 914; otherwise, flow proceeds to block 
916 . 
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[00153] At block 914, the store data is stored into the 
valid matching entry of stack cache 124 determined at 
decision block 912 via sc_write_data signal 216 into the 
dword offset of the cache line 206 indicated by address 
bits [5:2] of physical address 336. If necessary, the MESI 
state 202 of the top entry is updated via sc_write_MESI 
signal 212, such, as to a value of Modified. The store data 
is obtained from the register or memory location specified 
by the store instruction. For example, if the store 
instruction is an x86 MOV instruction specifying a general 
purpose register as the source of the store data, then the 
store data is in the register of register file 112 
specified as the source operand in the MOV instruction. In 
response to detection at block 912 that physical address 
336 hits in stack cache 124, control logic 302 generates a 
true value on sc_hit signal 3 89, which is provided to the 
store unit of execution units 114 . Flow ends at block 914 . 
[00154] At block 916, the tag portion of the physical 
address 336 generated at block 906 is compared with the 
physical tag of each way in the set of non- stack cache 122 
selected by the index portion of physical address 336. 
Flow proceeds to decision block 918. 

[00155] At decision block 918, control logic 302 examines 
non-sc_hit signal 366 to determine whether the destination 
physical address 33 6 of the store instruction hits in non- 
stack cache 122. If so, flow proceeds to block 922/ 
otherwise, flow proceeds to block 924. 

[00156] At block 922, the store data is stored into the 
valid matching way of the selected set of non-stack cache 
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122 determined at decision block 918. Flow ends at block 
922. 

[00157] At block 924, in response to the determination at 
decision block 918 that the store physical address 336 
misses in non-stack cache 122, non-stack cache 122 
allocates an entry therein for storing the missing cache 
line implicated by the store instruction physical address 
336. Flow proceeds to block 926. 

[00158] At block 926, non-stack cache 122 fetches the 
missing cache line from system memory or the L2 cache into 
the entry of non-stack cache 122 allocated at block 924. 
Flow proceeds to block 928. 

[00159] At block 928, non-stack cache 122 stores the 
store data into the cache line fetched at block 926. Flow 
ends at block 928. 

[00160] In one embodiment, blocks 902 through 906 and 916 
through 92 8 of Figure 9 are performed according to 
conventional cache techniques. That is, blocks 902 through 
906 and 916 through 928 depict a conventional store to 
conventional non- stack cache 122, which is performed in the 
event that the store address 336 misses in stack cache 124. 

[00161] Referring now to Figure 10, a timing diagram 
illustrating the timing of a fast pop operation of Figure 5 
from the stack cache 124 of Figure 1 according to the 
present invention is shown. Figure 10 includes four 
columns denoted 1 through 4, corresponding to four clock 
cycles of microprocessor 100. Figure 10 also includes five 
rows each labeled to signify a distinct action or result of 
microprocessor 100. • Each rectangle of a given row and 
column of Figure 10 is either blank or includes the word 
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"pop" to indicate the location of the pop instruction as it 
proceeds down the microprocessor 100 pipeline. 
[00162] In clock cycle 1, according to the first row of 
Figure 10, the load unit of execution units 114 of Figure 1 
generates a true value on pop_instr signal 344 of Figure 3 
to request pop data for a pop instruction, according to 
block 502 of Figure 5. 

[00163] In clock cycle 2, according to the second row, 
stack cache 124 of Figure 1 provides data to the pop 
instruction from the cache line in the top entry specified 
by fp_offset 396, according to block 504 of Figure 5. In 
particular, multiplexer 318 selects a dword 398 specified 
by fp_offset 396 from among the sixteen dwords provided on 
sc_data[0] 226 from the top stack cache 124 entry, and 
multiplexer 402 selects the fp_data input 398. 
Additionally, stack cache 124 indicates a hit of the pop 
instruction to the load unit on sc_hit signal 389. That 
is, stack cache 124 indicates to the load unit that the 
data for the pop instruction is present in stack cache 124. 
As discussed above with respect to Figure 5, the hit 
indication sc_hit 389 is speculative because it has not yet 
been verified that the source address of the pop 
instruction, which will be generated in clock cycle 3, is 
the same as the address of the pop data that will be 
provided from the top entry of stack cache 124 to the load 
unit in clock cycle 3. In one embodiment, the sc_hit 
signal 389 indicating the hit of the pop instruction to the 
load unit is gated with the valid bit sc_MESI [0] 222 of 
Figure 2, such that stack cache 124 does not indicate a hit 
of the pop instruction to the load unit unless the top 
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entry in stack cache 124 is valid. That is, although 
control logic 3 02 does not verify an address match before 
signifying a pop hit, it does verify that the top entry in 
stack cache 124 is valid. 

[00164] In clock cycle 2, according to the third row, 
address generator 306 calculates virtual address 334 of 
Figure 3, according to block 514 of Figure 5. 

[00165] In clock cycle 3, according to the fourth row, 
TLB 3 08 generates the source physical address 33 6 of Figure 
3 of the pop instruction, according to block 516 of Figure 
5. 

[00166] In clock cycle 4, according to the fifth row, 
control logic 3 02 detects a condition in which stack cache 
124 provided the incorrect pop data, according to blocks 
518 through 524 of Figure 5. 

[00167] As may be seen by comparing Figure 10 with Figure 
13, which is described below, the fast pop operation 
advantageously enables LI data cache 126 to potentially 
provide data for pop instructions multiple clock cycles 
sooner than a conventional cache, which does not 
distinguish between pop instructions and load instructions. 

[00168] In one embodiment, bits [5:2] of physical address 
336 are used to select the dword rather than fp_offset 396, 
and the data is provided in clock cycle 3 rather than clock 
cycle 2 . 

[00169] Referring now to Figure 11, a timing diagram 
illustrating the timing of a speculative load from the 
stack cache 124 operation of Figure 8 according to the 
present invention is shown. Figure 11 includes four 
columns denoted 1 through 4, corresponding to four clock 
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cycles of microprocessor 100. Figure 11 also includes six 
rows each labeled to signify a distinct action or result of 
microprocessor 100. Each rectangle of a given row and 
column of Figure 11 is either blank or includes the word 
"load" to indicate the location of the load instruction as 
it proceeds down the microprocessor 100 pipeline. 
[00170] In clock cycle 1, according to the first row of 
Figure 11, the load unit of execution units 114 of Figure 1 
generates a true value on load_instr signal 346 of Figure 3 
to request load data for a load instruction, according to 
block 802 of Figure 8. 

[00171] In clock cycle 2, according to the second row, 
address generator 306 calculates virtual address 334 of 
Figure 3, according to block 8 04 of Figure 8. 

[00172] In clock cycle 3, according to the third row, 
comparators 312 of Figure 3 perform a virtual tag compare 
to generate VA_match [1 : 0] signals 362 of Figure 3, 
according to block 806 of Figure 8. Additionally, control 
logic 3 02 generates spec_sc_load_jnux_sel 391 of Figure 3 
based on VA_match [1 : 0] signals 362 and sc_MESI[l:0] signal 
222 of Figure 2, according to block 812 of Figure 8. 
Additionally, stack cache 124 of Figure 1 indicates a hit 
of the load instruction to the load unit via sc_hit signal 
389, according to block 812 of Figure 8. That is, stack 
cache 124 indicates to the load unit that the data for the 
load instruction is present in stack cache 124. As 
discussed above with respect to Figure 8, the hit 
indication is speculative because it has not yet been 
verified that the physical source address 336 of the load 
instruction, which is generated in clock cycle 3, is the 
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same as the address of the load data that will be provided 
from stack cache 124 to the load unit in clock cycle 4 . 
[00173] In clock cycle 3, according to the fourth row, 
TLB 308 generates the source physical address 336 of Figure 

3 of the pop instruction, according to block 814 of Figure 
8 . 

[00174] In clock cycle 4, according to the fifth row, the 
load data is provided to the load unit, according to block 
812 of Figure 8. In particular, multiplexer 412 of Figure 

4 selects one of the two cache lines sc_data[l:0] 226 based 
on spec_sc_load_mux_sel 391, multiplexer 404 of Figure 4 
selects the appropriate dword based on physical address 
[5:2] 336, and multiplexer 402 selects input 424. 

[00175] In clock cycle 4, according to the sixth row, 
control logic 3 02 detects a condition in which stack cache 
124 provided the incorrect load data, according to blocks 
816 through 822 of Figure 8. 

[00176] As may be seen by comparing Figure 11 with Figure 
13, which is described below, the speculative load 
operation advantageously enables LI data cache 126 to 
potentially provide data for load instructions multiple 
clock cycles sooner than a conventional cache. 

[00177] Referring now to Figure 12, a timing diagram 
illustrating the timing of a normal, i.e., non-speculative, 
load from stack cache 124 operation of Figure 8 according 
to the present invention is shown. Figure 12 includes five 
columns denoted 1 through 5, corresponding to five clock 
cycles of microprocessor 100. Figure 12 also includes five 
rows each labeled to signify a distinct action or result of 
microprocessor 100. Each rectangle of a given row and 
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column of Figure 12 is either blank or includes the word 
"load" to indicate the location of the load instruction as 
it proceeds down the microprocessor 100 pipeline. 
[00178] In clock cycle 1, according to the first row of 
Figure 12, the load unit of execution units 114 of Figure '1 
generates a true value on load_instr signal 346 of Figure 3 
to request load data for a load instruction, according to 
block 802 of Figure 8. 

[00179] In clock cycle 2, according to the second row, 
address generator 306 calculates virtual address 334 of 
Figure 3, according to block 804 of Figure 8. 

[00180] In clock cycle 3, according to the third row, TLB 
308 generates the source physical address 336 of Figure 3 
of the pop instruction, according to block 824 of Figure 8. 

[00181] In clock cycle 4, according to the fourth row, 
comparators 314 of Figure 3 perform a physical tag compare 
to generate PA_match [15 : 0] signals 364 of Figure 3, 
according to block 826 of Figure 8. Additionally, control 
logic 3 02 generates normal_sc_load_mux_sel 3 93 of Figure 3 
based on PA_match [15 : 0] signals 364 and sc_MESI [15 : 0] 
signal 222 of Figure 2, according to block 832 of Figure 8. 
Additionally, stack cache 124 of Figure 1 indicates a hit 
of the load instruction to the load unit via sc_hit signal 
389, according to block 832 of Figure 8. 

[00182] In clock cycle 5, according to the fifth row, the 
load data is provided to the load unit, according to block 
832 of Figure 8. In particular, multiplexer 408 of Figure 
4 selects one of the sixteen cache lines sc_data [15 : 0] 226 
based on normal_sc_load_mux_sel 3 93, multiplexer 4 06 of 
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Figure 4 selects the appropriate dword based on physical 
address [5:2] 336, and multiplexer 402 selects input 426. 
[00183] As may be seen by comparing Figure 12 with Figure 
\L3, which is described below, the normal load operation 
advantageously enables LI data cache 126 to potentially 
provide data for load instructions sooner than a 
conventional cache . 

[00184] Referring now to Figure 13, a timing diagram 
illustrating the timing of a load from non- stack cache 122 
operation of Figure 8 according to the present invention is 
shown. Figure 13 includes six columns denoted 1 through 6, 
corresponding to six clock cycles of microprocessor 100. 
Figure 13 also includes six rows each labeled to signify a 
distinct action or result of microprocessor 100. Each 
rectangle of a given row and column of Figure 13 is either 
blank or includes the word u load" to indicate the location 
of the load instruction as it proceeds down the 
microprocessor 100 pipeline. 

[00185] In clock cycle 1, according to the first row of 
Figure 13, the load unit of execution units 114 of Figure 1 
generates a true value on load_.instr signal 34 6 of Figure 3 
to request load data for a load instruction, according to 
block 802 of Figure 8. 

[00186] In clock cycle 2, according to the second row, 
address generator 306 calculates virtual address 334 of 
Figure 3, according to block 8 04 of Figure 8. 
[00187] In clock cycle 3, according to the third row, TLB 
308 generates the source physical address 336 of Figure 3 
of the pop instruction, according to block 824 of Figure 8. 
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[00188] In clock cycle 4, according to the fourth row, 
non- stack cache 122 performs a conventional row decode 
based on the index portion of physical address 33 6 and 
reads the data from each of the ways of the set specified 
by the result of the row decode. 

[00189] In clock cycle 5, according to the fifth row, 
non-stack cache 122 performs a physical tag compare of the 
tag portion of physical address 33 6 with the tags of each 
way of the selected set. Based on the tag compares and the 
valid bits of each way, non-stack cache 122 generates a way 
select signal to select the matching valid way. 

[00190] In clock cycle 6, according to the sixth row, 
non- stack cache 122 muxes out the cache line specified by 
the way select and muxes out the appropriate dword of the 
selected cache line based on the lower bits of physical 
address 336. 

[00191] It is noted with respect to the timing diagrams 
of Figures 10 through 13 that other embodiments are 
contemplated in which the various functions described, such 
as address comparisons and multiplexing, are grouped into 
different clock cycles, and the fast pop, speculative load, 
normal load, and load from the non-stack cache 122 are not 
limited to the particular embodiments shown. 

[00192] As may be observed from the preceding 
description, an advantage of having a distinct stack cache 
124 and non-stack cache 122 is that the arrangement 
effectively increases the size of the LI data cache 126 
over a conventional unitary cache that does not distinguish 
between stack and non- stack accesses, without increasing 
the access time of the LI data cache 126. Furthermore, by 
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not polluting the non- stack cache 122 with stack data, the 
efficiency of the non-stack cache 122 is increased over a 
conventional cache memory of the same size with respect to 
the entirety of the data accessed by a program. 
Additionally, the stack cache 124 advantageously provides 
faster accesses for most pop instructions by recognizing 
that, due to the LIFO nature of stack accesses, the data 
requested by a pop instruction is highly likely to be at 
the top of the stack cache 124 since it was highly likely 
the most recently pushed, or newest, data in the stack 
cache 124. Therefore, the stack cache 124 speculatively 
provides the pop data before determining whether the pop 
address actually hits in the stack cache 124. Furthermore, 
the stack cache 124 advantageously provides faster accesses 
for most load instructions that access stack data by 
recognizing that, due to the LIFO nature of stack accesses, 
the load data is highly likely to be in the cache line or 
lines near the top of the stack cache 124. Therefore, the 
stack cache 124 speculatively provides the load data from 
one of the top stack cache entries based on a virtual 
address compare before performing a physical address 
compare to definitely determine that the load data is 
present. This allows the stack cache 124 to provide the 
load data sooner in most cases than if a physical address 
compare was first performed, since additional time is 
required to translate the virtual address to a physical 
address. Finally, if the load virtual address does not hit 
in the top stack cache 124 entries such that the load data 
cannot be speculatively provided to the load instruction, 
the stack cache 124 provides the load data if the load 
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physical address hits in the stack cache 124. If the load 
physical address does not hit in the stack cache 124, the 
non- stack cache 122 provides the load data. Hence, the 
latency time required to read data from the stack cache 124 
is variable, with more predictable accesses requiring less 
clock cycles. The latency varies in one aspect depending 
upon the type of instruction reading the stack cache 124. 
The latency varies in another aspect depending upon the 
location of the requested data within the stack cache 124. 
[00193] Referring now to Figure 14, a block diagram of a 
pipelined microprocessor 1400 according to the present 
invention is shown. Microprocessor 14 00 is similar to 
microprocessor 100 of Figure 1, except that microprocessor 
1400 includes an LI data cache 1402 that does not include a 
stack cache 124. LI data cache 1402 of Figure 14 comprises 
a conventional LI data cache having an apparatus for 
performing a fast pop operation from LI data cache 1402, as 
described below. 

[00194] Referring now to Figure 15, a block diagram 
illustrating the LI data cache 1402 of Figure 14 according 
to the present invention is shown. Several elements of 
Figure 15 are similar to and function similar to elements 
of Figure 3, and similar elements are numbered 
correspondingly. In particular, data cache 14 02 includes 
address generator 306 that receives operands 332 and 
generates virtual address 334; TLB 3 08 that receives 
virtual address 334 and generates physical address 336; 
arithmetic unit 304 that receives add signal 382, decrement 
signal 384, and increment signal 386, and generates 
underflow signal 388, and overflow signal 3 92; and 
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multiplexer 316, multiplexer 318, fp_offset register 322, 
add_sp_val signal 394, stack pointer register bits [5:2] 
152, output signal 372, and fp_offset signal 3 96 that 
function similarly to like-numbered elements described with 
respect to Figure 3, except where described differently 
below. Data cache 1402 also includes control logic 1502, 
which functions in some ways similarly to control logic 302 
of Figure 3 . Control logic 1502 receives push_instr signal 
342, pop_instr signal 344, and add_sp_instr signal 352 
similar to control logic 3 02 of Figure 3. Control logic 
1502 generates mux select signal 368 similar to control 
logic 302 of Figure 3. Control logic 1502 generates 
exception signal 399 in response to detection of an 
incorrect fast pop operation similar to like numbered 
signal of Figure 3, except where described differently 
below. 

[00195] Data . cache 1402 also includes a storage element 
array 1504, for storing a plurality of cache lines, an 
address tag of each of the cache lines, and a cache status, 
such as MESI state, of each of the cache lines. In the 
embodiment • of Figure 15, storage element array 1504 is 
configured to have N rows, or sets, and four columns, or 
ways. That is, data cache 1402 is configured as a four-way 
set associative cache memory. However, the present 
invention is not limited to a cache with a particular 
number of ways. In one embodiment, the size of a cache 
line stored in storage element array 1504 comprises 64 
bytes . 

[00196] Data cache 1402 also includes a row decode 
circuit 1506. Row decoder 1506 receives a row signal 1552 
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specifying one of the N rows of storage element array 1504. 
Row decoder 1506 generates a true value on one of a 
plurality of read [N- 1:0] signals 1542 specified by the row 
signal 1552. In response, storage element array 1504 
outputs the contents 1594 of the row specified by the true 
read[N-l:0] signal 1542. That is, the cache line data, 
tag, and MESI state of each way of the selected row is 
output on signal 1594. In the embodiment of Figure 15, 
four cache lines each comprising sixteen dwords are output 
on signal 1594, along with their associated tags 1574 and 
valid bits 1576 of the MESI state. 

[00197] Data cache 1402 also includes a four-input 
multiplexer 1528 coupled to storage element array 1504. 
Multiplexer 1528 receives on each of its four inputs one of 
the respective four cache lines 1594 output by storage 
element array 1504. Multiplexer 1528 selects one of the 
cache lines to output on a signal 1592 based on a control 
input 1596. The cache line selected 1592 is provided to 
multiplexer 318, which provides a dword on bus 13 8 based on 
fp_offset signal 396. 

[00198] Data cache 1402 also includes a fast_pop signal 
1564 generated by control logic 1502. Control logic 1502 
generates a true value on fast_pop signal 1564 in response 
to a true value on pop_instr signal 344 to cause a fast_pop 
operation to be performed from data cache 1402. 
[00199] Data cache 1402 also includes a first stack of 
storage elements, or entries, referred to as fp_row stack 
1516, coupled to control logic 1502. The fp_row stack 1516 
comprises a plurality of storage elements each for storing 
a value identifying a row of storage element array 1504. 
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In one embodiment, each element of fp_row stack 1516 stores 
log 2 N bits, wherein N is the number of rows of storage 
element array 1504. The plurality of storage elements of 
fp_row stack 1516 are arranged as a stack, or LIFO, which 
includes a top entry 1514 that stores the most recently 
pushed row value provided on new_row signal 1554 by control 
logic 1502. That is, new__row signal 1554 specifies the row 
within storage element array 1504 that stores the cache 
line containing the data of the most recent push 
instruction, as described in detail below with respect to 
Figure 17. Advantageously, storing the row containing the 
most recent push data enables data cache 14 02 to perform a 
fast pop operation as described below. The fp_row stack 
1516 also receives a push_row signal 1562 from control 
logic 1502. When control logic 1502 asserts a true value 
on push_row signal 1562, fp_row stack 1516 is shifted down 
one entry, i.e., the bottom entry is shifted out of fp_row 
stack 1516 and each of the other entries receives the value 
of the entry immediately above it, and the value on new_row 
1554 is written into the top entry of fp_row stack 1516. 
The fp__row stack 1516 also receives a pop_row signal 1558 
from control logic 1502. When control logic 1502 asserts a 
true value on pop_row signal 1558, fp_row stack 1516 is 
shifted up one entry, i.e., the top entry is shifted out of 
fp_row stack 1516, and each of the other entries receives 
the value of the entry immediately below it. 
[00200] Data cache 1402 also includes a two-input 
multiplexer 1512 coupled to fp_row stack 1516. On one 
input, multiplexer 1512 receives the value of the top entry 
1514 of fp_row stack 1516, denoted fp_row 1556. On the 
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other input, multiplexer 1512 receives an index, or row 
select, portion 1548 of physical address 336 from TLB 308. 
In one embodiment, index 1548 comprises lower address bits 
of physical address 336. If fast_pop signal 1564 is true, 
then multiplexer 1512 selects fp_row signal 1556 for output 
on row signal 1552 for provision to row decoder 1506; 
otherwise, multiplexer 1512 selects index 1548 for output 
on row signal 1552. 

[00201] Data cache 1402 also includes a second stack of 
storage elements, or entries, referred to as fp_way stack 
1534, coupled to control logic 1502. The fp_way stack 1534 
comprises a plurality of storage elements each for storing 
a value identifying a way of storage element array 1504. 
In the embodiment of Figure 15, each element of fp_way 
stack 1534 stores 2 bits, for specifying one of the four 
ways of storage element array 1504. The plurality of 
storage elements of fp_way stack 1534 are arranged as a 
stack, or LIFO, which includes a top entry 1532 that stores 
the most recently pushed way value provided on new_way 
signal 1582 by control logic 1502. That is, new_way signal 
1582 specifies the way within the row of storage element 
array 1504 specified by new_row signal 1554 that stores the 
cache line containing the data of the most recent push 
instruction, as described in detail below with respect to 
Figure 17. Advantageously, storing the way containing the 
most recent push data enables data cache 14 02 to perform a 
fast pop operation as described below. The fpjway stack 
1534 also receives a push__way signal 1588 from control 
logic 1502. When control logic 1502 asserts a true value 
on push_way signal 158 8, fp_way stack 1534 is shifted down 
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one entry, i.e., the bottom entry is shifted out of fp_way 
stack 1534 and each of the other entries receives the value 
of the entry immediately above it, and the value on new_way 
1582 is written into the top entry 1532 of fp_way stack 
1534. The fp_way stack 1534 also receives a pop_way signal 
1586 from control logic 1502. When control logic 1502 
asserts a true value on pop_way signal 1586, fp_way stack 
1534 is shifted up one entry, i.e., the top entry is 
shifted out of fp_way stack 1534, and each of the other 
entries receives the value of the entry immediately below 
it. 

[00202] In one embodiment, fp_row stack 1516 and fp__way 
stack 1534 are comprised in a single stack of storage 
elements that each store a row/way pair. 

[00203] Data cache 1402 also includes a two-input 
multiplexer 1526 coupled to fp_way stack 1534. On one 
input, multiplexer 1526 receives the value of the top entry 
1532 of fp_way stack 1534, denoted fp_way 1584. On the 
other input, multiplexer 1526 receives a normal_way_select 
signal 1578. If fast_pop signal 1564 is true, then 
multiplexer 1526 selects fp_way signal 1584 for output on 
mux select signal 1596 for provision to multiplexer 1528; 
otherwise, multiplexer 1526 selects normal_way__select 
signal 1578 for output on mux select signal 1596. 

[00204] In one embodiment, each entry of fp_way stack 
1534 and fp_row stack 1516 includes a valid bit, and 
fast_pop signal 1564 is gated with the logical AND of the 
valid bit of top entry 1514 and top entry 1532. That is, 
although control logic 1502 does not verify a pop source 
address match before performing a fast pop, it does verify 
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that the top entry 1514 in fp_row stack 1516 is valid and 
that the top entry 1532 in fp_way stack 1534 is valid 
before performing a fast pop operation. In this 

.embodiment, each time. the fp_row stack 1516 or fp_way stack 
1534 is popped, the bottom entry after shifting up has its 
valid bit set to false. 

[00205] Data cache 1402 also includes a way select 
generator 1524 coupled to control logic 1502. Way select 
generator 1524 receives each of the address tags 1574 and 
valid bits 1576 from the selected row of storage element 
array 1504. Way select generator 1524 also receives an 
address tag portion 1546 of physical address 336 from TLB 
308. Way select generator 1524 compares physical address 
tag 1546, such as of a pop, push, load, or store 
instruction, with each of the tags 1574 output by storage 
element array 1504. If one of the tags 1574 matches the 
physical address tag 1546 and its corresponding valid bit 
1576 indicates that tag 1574 is valid, then way select 
generator 1524 generates a true value on a cache_hit signal 
1572 provided to control logic 1502. In addition, way 
select generator 1524 provides the value of the valid 
* matching way, i.e., the way that hits in storage element 
array 1504, on norma l_way_select signal 1578, which is 
provided to control logic 1502 and to multiplexer 1526. 
[00206] Data cache 1402 also includes check logic 1508, 
coupled to storage element array 1504. Check logic 1508 
receives physical address 336, fast_pop signal 1564, fp_row 
signal 1556, fp_way signal 1584, tags 1574, valids 1576, 
and fp_offset signal 396. Check logic 1508 checks to 
determine whether the data speculatively provided to a pop 
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instruction during a fast pop operation is the correct 
data. Check logic 1508 determines whether the correct row 
and way values provided by fp_row 1556 and fp_way 1584, 
respectively, were used during the fast pop operation to 
select the correct cache line in storage element array 1504 
to provide the correct pop data. In one embodiment, check 
logic 15 08 compares the value of fp_row 1556 used in the 
fast pop operation with the tag 1574 of the way specified 
by fp_way 1584 in the fast pop operation. In one 
embodiment, check logic 1508 also compares the fp_row 1556 
value used in the fast pop operation with the corresponding 
bits of physical address 336. In one embodiment, check 
logic 1508 also compares the value of fp_offset 396 used in 
the fast pop operation with the corresponding bits of 
physical address 336. Check logic 1508 also verifies that 
the valid bit 1576 of the way specified by fp_way 1584 
indicates the cache line accessed in the fast pop operation 
was a valid cache line. If the cache line was not valid, 
or the correct cache line was not accessed, then check 
logic 1508 generates a false value on an fp_check signal 
1544, which is provided to control logic 1502. Otherwise, 
check logic 1508 generates a true value on an fp_check 
signal 1544, which is provided to control logic 1502. 
[00207] Referring now to Figure 16, a flowchart 
illustrating a fast pop operation from the data cache 1402 
of Figure 15 according to the present invention is shown. 
Flow begins at block 1602. 

[00208] At block 1602, instruction translator 106 decodes 
a pop instruction and instruction scheduler 108 issues the 
pop instruction to the load unit of execution units 114. of 
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Figure 14. In response, the load unit generates a true 
value on pop_instr signal 344. Flow proceeds to block 
1604 . 

[00209] At block 1604, in response to the true value on 
pop_instr signal 344, control logic 1502 generates a true 
value on fast__pop signal 1564. Consequently, multiplexer 
1512 selects fp_row 1556 for provision on row signal 1552 
to row decoder 1506. In response, row decoder 1506 
generates a true value on one of the read[N-l:0] signals 
1542 specified by fp_row 1556. In response, storage 
element array 1504 outputs the row of the true read[N-l:0] 
signal on output 1594 . In response to the true value on 
fast_pop signal 1564, multiplexer 1526 selects the fp_way 
input 1584 for provision on mux select signal 1596, which 
is provided to multiplexer 1528. In response, multiplexer 
1528 selects the cache line from the way specified by 
fp_way 1584 for output on signal 1592. Multiplexer 318 
selects the appropriate dword from the cache line 1592 
output by multiplexer 152 8 for provision on bus 13 8 based 
on the value currently stored in fp_offset register 322 for 
provision on bus 13 8 to the load unit of execution units 
114 for provision to the pop instruction, which write-back 
stage 116 subsequently loads into one of the registers of 
register file 112 of Figure 14 specified in the pop 
instruction. For example, if the pop instruction is an x86 
RET instruction, then the pop data is loaded into the 
instruction pointer register of register file 112. For 
example, if the pop instruction is an x86 LEAVE 
instruction, then the pop data is loaded into the x86 EBP 
of register file 112. For example, if the pop instruction 
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is an x86 POP instruction, then the ( pop data is loaded into 
the register of register file 112 specified in the POP 
instruction. As may be observed from Figure 16, the data 
is provided to the load unit speculatively. The operation 
is speculative because it has not yet been verified that 
the source address of the pop instruction, which will be 
subsequently generated on physical address 336 at block 
1616, is the same as the address of the pop data provided 
from the entry of storage element array 1504 specified by 
fp_row 1556 and fp__way 1584 to the load unit. Flow 
proceeds to block 1606. 

[00210] At block 1606, control logic 1502 generates a 
true value on increment signal 386, and arithmetic unit 304 
responsively increments fp_offset 3 96 and provides the 
incremented value on output 372, which control logic 1502 
causes multiplexer 316 to select via control signal 368 for 
loading into fp_offset register 322. Flow proceeds to 
decision block 1608. 

[00211] At decision block 1608, control logic 1502 
examines overflow signal 3 92 to determine whether the 
increment operation performed at block 1606 caused an 
overflow of fp_offset 322. That is, control logic 1502 
determines whether the pop instruction will cause the stack 
pointer 152 to wrap to the next cache line. If so, flow 
proceeds to block 1612; otherwise, flow proceeds to block 
1614 . 

[00212] At block 1612, control logic 1502 generates a 
true value on pop_row signal 1558 to pop the top entry off 
fp_row stack 1516, and control logic 1502 generates a true 
value on pop_way signal 1586 to pop the top entry off 
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fp_way stack 1534 . The top entries are popped off to keep 
them consistent with the system memory cache, since the 
last dword in the cache line stored in the entry of storage 
element array 1504 specified by the top entry 1514 of 
fp_row stack 1516 and the top entry 1532 of fp_way stack 
1534 is now being popped off the system memory stack by the 
pop instruction. In one embodiment, block -1612 is not 
performed until block 1618, described below, has been 
performed. In one embodiment, the fp_row 1556 and fp_way 
1584 value used at block 1604 is saved for subsequent use * 
at block 1618. Flow proceeds to block 1614. 
[00213] At block 1614, address generator 306 calculates 
the source virtual address 334 of the pop instruction. 
Flow proceeds to block 1616. 

[00214] At block 1616, TLB 308 generates the source 
physical address 336 of the pop instruction. Flow proceeds 
to block 1618. 

[00215] At block 1618, check logic 1508 compares the 
corresponding portion of physical address 336 generated at 
block 1616 with the tag 1574 selected by fp_way 1584, and 
compares the corresponding portion of physical address 336 
with fp_row 1556, and compares the corresponding portion of 
physical address 336 with fp_offset 396, and checks the 
valid 1576 selected by fp_way 1584 to generate fp_check 
signal 1544, which is provided to control logic 1502. Flow 
proceeds to decision block 1622. 

[00216] At decision block 1622, control logic 1502 
examines fp_check signal 1544 to determine whether the pop 
instruction source physical address 336 hits in the entry 
of storage element array 1504 specified by the top entries 
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of fp_row stack 1516 and fp_way stack 1534. If the pop 
instruction source address 336 hits in the entry of storage 
element array 1504 specified by the top entry of fp_row 
stack 1516 and fp_way stack 1534, flow ends, i.e., the 
speculative fast pop operation provided the correct pop 
data. Otherwise, flow proceeds to block 1624. 
[00217] At block 1624, control logic 1502 generates a 
true value on exception signal 399 to cause microprocessor 
1400 to branch to an exception handler for handling the 
condition in which the speculative fast pop operation 
provided the incorrect pop data. The exception handler 
causes the correct data to be provided to the pop 
instruction. In one embodiment, the exception handler 
flushes fp_row stack 1516 and fp_way stack 1534 and loads 
the current value of bits [5:2] of the stack pointer 
register 152 into fp_offset register 322. Flow ends at 
block 1624. 

[00218] As may be observed, and as will be discussed in 
more detail below with respect to Figure 19, the fast pop 
operation described with respect to Figure 16 enables pop 
data to be provided to a pop instruction potentially 
multiple clock cycles faster with a conventional cache 
memory than without the fast pop apparatus. 

[00219] Referring now to Figure 17, a flowchart 
illustrating a push operation to the data cache 1402 of 
Figure 15 according to the present invention is shown. 
Flow begins at block 1702. 

[00220] At block 1702, instruction translator 106 decodes 
a push instruction and instruction scheduler 108 issues the 
push instruction to the store unit of execution units 114. 
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In response, store unit generates a true value on 
push_instr signal 342. Flow proceeds to block 1704. 
[00221] At block 1704, control logic 1502 generates a 
true value on decrement signal 384, and arithmetic unit 304 
responsively decrements fp_offset 3 96 and provides the 
decremented value on output 372, which control logic 1502 
causes multiplexer 316 to select via control signal 368 for 
loading into fp_offset register 322. Flow proceeds to 
decision block 1706. 

[00222] At decision block 1706, control logic 1502 
examines underflow signal 3 88 to determine whether the 
decrement of fp_offset 3 96 at block 1704 caused and 
underflow of • fp_off set 322. That is, control logic 1502 
determines whether the push instruction will cause the 
stack pointer 152 to wrap to the previous cache line. If 
so, flow proceeds to decision block 1716; otherwise, flow 
proceeds to decision block 1708. 

[00223] At decision block 1708, control logic 1502 
examines cache_hit signal 1572 to determine whether the 
push instruction destination physical address 336 hits in 
storage element array 1504. If so, flow proceeds to block 
1712; otherwise, flow proceeds to block 1714. 

[00224] At block 1712, data cache 1402 handles the push 
instruction as a normal push instruction that hits in data 
cache 1402. That is, data cache 1402 handles the push 
instruction according to conventional methods well-known in 
the art of data caches . There is no need to update f p_row 
stack 1516 and fp_way stack 1534 since the push did not 
wrap to a previous cache line; hence, a subsequent pop 
operation is highly likely to specify data in the cache 
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line specified by the top entry 1514 of fp_row stack 1516 
and top entry 1532 of fp_way stack 1534. Flow ends at 
block 1712. 

[00225] At block 1714, control logic 1502 generates a 
true value on exception signal 3 99 to cause microprocessor 
140 0 to branch to an exception handler to update fp_row 
stack 1516 and fp_way stack 1534. In one embodiment, the 
exception handler flushes fp_row stack 1516 and fp_way 
stack 1534 and loads the current value of bits [5:2] of- the 
stack pointer register 152 into fp_offset register 322. 
Flow proceeds to block 1726. 

[00226] At decision block 1716/ control logic 1502 
examines cache_hit signal 1572 to determine whether the 
push instruction destination physical address 336 hits in 
storage element array 1504. If so, flow proceeds to block 
1718; otherwise, flow proceeds to block 1726. 

[00227] At block 1718, control logic 1502 determines the 
row and way that hit in storage element array 1504. The 
row is specified by index 154 8. The way is specified by 
norma l_way_s elect 1578. Control logic 1502 provides the 
hitting way on new_way signal 1582 to fp_way stack 1534. 
Additionally, control logic 1502 provides the hitting row 
on new_row signal 1554 to fp_row stack 1516. Flow proceeds 
to block 1722. 

[00228] At block 1722, control logic 1502 generates a 
true value on push_row signal 1562 to push the value 
provided on new_row 1554 onto fp__row stack 1516. Control 
logic 1502 also generates a true value on push_way signal 
1588 to push the value provided on new_way 1582 onto fp__way 
stack 1534. Flow proceeds to block 1724. 
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[00229] At block 1724, data cache 1402 handles the push 
instruction as a normal push instruction that hits in data 
cache 1402. That is, after the fp_row stack 1516 and 
fp_way stack 1534 are updated at block 1722, data cache 
14 02 handles the push instruction according to conventional 
methods well-known in the art of data caches. Flow ends at 
block 1724. 

[00230] At block 1726, control logic 1502 determines the 
way in the row of storage element array 1504 selected by 
index 1548 to be replaced by the cache line implicated by 
the missing push address 3 36 that must now be fetched into 
data cache 1402. In one embodiment, control logic 1502 
selects the least recently used way of the selected row. 
Control logic 1502 provides the replacement way on new_way 
signal 1582 to fp_way stack 1534. Additionally, control 
logic 1502 provides the row specified by index 1548 on 
new_row signal 1554 to fp_row stack 1516. Flow proceeds to 
block 1728. 

[00231] At block 1728, control logic 1502 generates a 
true value on push_row signal 1562 to push .the value 
provided on new__row 1554 onto fp_row stack 1516. Control 
logic 1502 also generates a true value on push_way signal 
1588 to push the value provided on new_way 1582 onto fp_way 
stack 1534. Flow proceeds to block 1732. 

[00232] At block 1732, data cache 1402 handles the push 
instruction as a normal push instruction that misses in 
data cache 1402. That is, after the fp_row stack 1516 and 
fp_way stack 1534 are updated at block 1728, data cache 
14 02 handles the push instruction according to conventional 
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methods well-known in the art of data caches. Flow ends at 
block 1732. 

[00233] Referring now to Figure 18, a flowchart 
illustrating operation of microprocessor 1400 of Figure 14 
in response to an add to stack pointer instruction 
according to the present invention is shown. Flow begins 
in Figure 18 at block 1802. 

[00234] At block 1802, instruction translator 106 decodes 
an add instruction whose destination is stack pointer 
register 152 of Figure 14 and instruction scheduler 108 
issues the add instruction to the integer unit of execution 
units 114. In response, the integer unit generates a true 
value on add_sp_instr signal 352. Flow proceeds to block 
1804. 

[00235] At block 1804, control logic 1502 generates a 
true value on add signal 382, and arithmetic unit 304 
responsively adds add_sp_val 394 to fp_offset 396 and 
provides the sum on output 372, which control logic 1502 
causes multiplexer 316 to select via control signal 368 for 
loading into fp_offset register 322. Flow proceeds to 
decision block 1806. 

[00236] At decision block 1806, control logic 1502 
examines overflow signal 392 to determine whether the add 
operation performed at block 18 04 caused an overflow of 
fp_offset 322. That is, control logic 1502 determines 
whether the add instruction will cause the stack pointer 
152 to wrap to another cache line. At block 1806, an 
overflow condition is a condition in which the add causes 
stack pointer 152 to no longer reference the cache line 
stored in the entry of data cache 14 02 specified by fp_row 
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stack 1516 top entry 1514 and fp_way stack 1534 top entry 
1532. In particular, if the add causes an overflow, stack 
pointer 152 typically references the cache line whose 
memory address is immediately adjacent to and greater than 
the memory address of the cache line stored in the entry of 
data cache 1402 specified by fp_row stack 1516 top entry 
1514 and fp_way stack 1534 top entry 1532. Consequently, 
fp_row stack 1516 and fp_way stack 1534 must be popped in 
order for the correct cache line to be specified by fp_row 
stack 1516 top entry 1514 and fp_way stack 1534 top entry 
1532. In one embodiment, control logic 1502 accommodates 
an add to stack pointer 152 that overflows more than one 
cache line. In this embodiment, the number of entries, N, 
popped from fp_row stack 1516 and fp_way stack 1534 at 
block 1808 below is calculated as follows, assuming a cache 
line size of 64 bytes: 

N = (fp_offset + add_sp_val) / 64 

Hence, if N is greater than 1, then an overflow has 
occurred. If an overflow condition occurred, flow proceeds 
to block 1808; otherwise flow ends. 

[00237] At block 1808, control logic 1502 generates a 
true value on pop_row signal 1558 to pop the top entry off 
fp_row stack 1516, and control logic 1502 generates a true 
value on pop_way signal 1586 to pop the top entry off 
fp_way stack 1534. As discussed above with respect to 
block 1806, in one embodiment, the value of N is 
calculated, and N entries are popped from fp_row stack 1516 
and fp_way stack 1534. Flow ends at block 1808. 
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[00238] Referring now to Figure 19, a timing diagram 
illustrating the timing of a fast pop operation of Figure 
16 from the data cache 14 02 of Figure 15 according to the 
present invention is shown. Figure 19 includes four 
columns denoted 1 through 4, corresponding to four clock 
cycles of microprocessor 1400. Figure 19 also includes six 
rows each labeled to signify a distinct action or result of 
microprocessor 1400. Each rectangle of a given row and 
column of Figure 19 is either blank or includes the word 
"pop" to indicate the location of the pop instruction as it 
proceeds down the microprocessor 1400 pipeline. 

[00239] In clock cycle 1, according to the first row of 
Figure 19, the load unit of execution units 114 generates a 
true value on pop_instr signal 344 to request pop data for 
a pop instruction, according to block 1602 of Figure 16. 

[00240] In clock cycle 2, according to the second row, 
row decoder 1506 decodes the row value provided on fp_row 
signal 1556 to generate a true value on one of the read [N- 
1:0] signals 1542, according to block 1604 of Figure 16. 
In response, storage element array 1504 provides the cache 
line, tag and status of each entry in the four ways of the 
row selected by the true read[N-l:0] signal 1542, according 
to block 1604 of Figure 16. 

[00241] In clock cycle 2, according to the third row, 
address generator 3 06 calculates virtual address 334, 
according to block 1614 of Figure 16. 

[00242] In clock cycle 3, according to the fourth row, 
multiplexer 1528 muxes out the cache line 1592 specified by 
fp_way 1584 and multiplexer 318 muxes out the appropriate 
dword of the selected cache line 1592 specified by 
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fp_offset 396, according to block 1604 of Figure 16. In 
one embodiment, the appropriate dword of the selected cache 
line 1592 specified by the lower bits [5:2] of physical 
address 336 are muxed out. 

[00243] In clock cycle 3, according to the fifth row, TLB 
3 08 generates the source physical address 336 of the pop 
instruction, according to block 1616 of Figure 16. 

[00244] In clock cycle 4, according to the sixth row, 
control logic 1502 examines fp_check 1544 to determine 
whether an incorrect speculative pop operation has been 
performed, according to blocks 1618 through 1624 of Figure 
16. 

[00245] In one embodiment, the timing of a load 
instruction with respect to the data cache 1402 of Figure 
15 is similar to the timing of a load instruction with 
respect to non-stack cache 122 of Figure 1; hence, Figure 
13 describes the timing of a load instruction with respect 
to the data cache 1402. As may be seen by comparing Figure 
19 with Figure 13, the fast pop operation of Figure 16 
advantageously enables data cache 14 02 to potentially 
provide data for pop instructions multiple clock cycles 
sooner than a conventional cache, which does not include 
the fast pop apparatus of Figure 15, and which does not 
distinguish between pop instructions and load instructions. 
[00246] In one embodiment, bits [5:2] of virtual address 
334 are used to select the dword rather than fp_offset 396. 
[00247] Although the present invention and its objects, 
features and advantages have been described in detail, 
other embodiments are encompassed by the invention. For 
example, the stack cache or LIFO memory may be embodied in 
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various ways to accomplish a memory that functions as a 
last-in-first-out memory. One example embodiment is a 
register file functioning as ' a circular FIFO memory for 
which top and bottom of stack pointers are maintained in 
order to determine which entry is to be pushed or popped 
next and when the stack has been emptied. Furthermore, 
although embodiments have been described with respect to 
x86 architecture instructions, in which the stack grows 
toward decreasing memory addresses, the present invention 
may be employed in other microprocessors that have stack 
access instructions in which the stack grows toward 
increasing memory addresses. In addition, although 

embodiments of a particular cache line size are disclosed, 
caches with various line sizes may be employed. 
[00248] Also, although the present invention and its 
objects, features and advantages have been described in 
detail, other embodiments are encompassed by the invention. 
In addition to . implementations of the invention using 
hardware, the invention can be implemented in computer 
readable code (e.g., computer readable program code, data, 
etc.) embodied in a computer usable (e.g., readable) 
medium. The computer code causes the enablement of the 
functions or fabrication or both of the invention disclosed 
herein. For example, this can be accomplished through the 
use of general programming languages (e.g., C, C++, JAVA, 
and the like); GDSII databases; hardware description 
languages (HDL) including Verilog HDL, VHDL, Altera HDL 
(AHDL) , and so on; or other programming and/or circuit 
(i.e., schematic) capture tools available in the art. The 
computer code can be disposed in any known computer usable 
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(e.g., readable) medium including semiconductor memory, 
magnetic disk, optical disk (e.g., CD-ROM, DVD-ROM, and the 
like), and as a computer data signal embodied in a computer 
usable (e.g., readable) transmission medium (e.g., carrier 
wave or any other medium including digital, optical or 
analog-based medium) . As such, the computer code can be 
transmitted over communication networks, including 
Internets and intranets. It is understood that the 
invention can be embodied in computer code (e.g., as part 
of an IP (intellectual property) core, such as a 
microprocessor, core, or as a system- level design, such as a 
System on Chip (SOC) ) and transformed to hardware as part 
of the production of integrated circuits. Also, the 
invention may be embodied as a combination of hardware and 
computer code. 

[00249] Finally, those skilled in the art should 
appreciate that they can readily use the disclosed 
conception and specific embodiments as a basis for 
designing or modifying other structures for carrying out 
the same purposes of the present invention without 
departing from the spirit and scope of the invention as 
defined by the appended claims. 



I claim: 



